00000001:02000400:2.0F:1789448062.413542:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789448082.690731:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789448084.605869:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 855 MB/s 00000001:01000000:3.0:1789448084.855389:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 827 MB/s 00000001:01000000:2.0:1789448085.110054:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4763 MB/s 00000020:02000000:3.0:1789448085.942197:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_gc6c2479 00000400:02000000:0.0F:1789448087.354487:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.154@tcp [8/256/0/180] 00008000:02000000:2.0:1789448091.128540:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789448142.032886:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789448152.084613:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789448152.084619:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789448152.084830:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c0756062 00000080:02000400:2.0:1789448152.084841:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789448152.090713:0:5814:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789448152.090729:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789448152.090768:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b776e3af) 00000020:00000080:2.0:1789448152.090789:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789448152.124109:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789448152.129833:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789448152.185175:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789448152.185287:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789448152.185309:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789448152.185362:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789448152.185415:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789448152.185806:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789448152.185813:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789448152.185824:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f9446 00000020:01000004:2.0:1789448152.185831:0:5814:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789448152.185835:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789448152.185839:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c0756062 from MGS 00000020:01000004:2.0:1789448152.185843:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789448152.185852:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000aef09400) 00000020:00000080:2.0:1789448152.185861:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789448152.185911:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0756062 from MGS, refs=2 00080000:01000000:2.0:1789448152.185915:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789448152.185919:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f9454 00000100:00100000:2.0:1789448152.186014:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789448152.186150:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789448152.186157:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789448152.194305:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789448152.195472:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789448152.197808:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448152.197987:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789448152.197993:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789448152.198827:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789448152.198835:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789448152.199094:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789448152.199099:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789448152.199967:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448152.199971:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448152.199973:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448152.200213:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448152.200495:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448152.200497:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448152.201291:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789448152.205161:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789448152.450362:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2235 MB/s 00000001:01000000:2.0:1789448152.700276:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2779 MB/s 00000001:01000000:2.0:1789448152.954772:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 417 MB/s 00000001:01000000:3.0:1789448153.205477:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 541 MB/s 00080000:10000000:0.0:1789448153.219648:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789448153.242105:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789448153.261482:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789448153.261505:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789448153.261507:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789448153.266540:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789448153.266634:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789448153.266715:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789448153.267182:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789448153.267212:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789448153.269180:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448153.269397:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789448153.269403:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789448153.274829:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789448153.275013:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789448153.275524:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789448153.275531:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789448153.288852:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789448153.288901:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:2.0:1789448153.288904:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789448153.288948:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:2.0:1789448153.288960:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (000000006d1786c8) 00000020:00000080:2.0:1789448153.288976:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789448153.289069:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000584cc8ef@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789448153.289289:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:2.0:1789448153.289295:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789448153.296890:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789448153.300194:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789448153.300801:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 8c7fbad7-cbfc-4005-a352-7f3edcab574e) 00000020:00000080:3.0:1789448153.300824:0:5814:0:(genops.c:1384:class_connect()) connect: client 8c7fbad7-cbfc-4005-a352-7f3edcab574e, cookie 0xe29566c2465f9462 00000100:00080000:3.0:1789448153.300837:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448153.300978:0:5814:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import 00000000584cc8ef using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448153.301030:0:5814:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000046f5f811 x1876372317274240/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448153.301058:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS 00000020:01000004:3.0:1789448153.301075:0:5814:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789448153.301080:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789448153.301098:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000e33eb73) 00000020:00000080:3.0:1789448153.301109:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789448153.302024:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046f5f811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317274240:0@lo:250: 00000100:00100000:0.0:1789448153.302125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448153.302302:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274240 00000100:00100000:0.0:1789448153.302310:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274240 00000100:00100000:0.0:1789448153.302350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448153.302357:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f175107f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1876372317274240:12345-0@lo:250: 00010000:00080000:0.0:1789448153.302378:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8c7fbad7-cbfc-4005-a352-7f3edcab574e@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1789448153.302400:0:5826:0:(genops.c:1384:class_connect()) connect: client 8c7fbad7-cbfc-4005-a352-7f3edcab574e, cookie 0xe29566c2465f9470 00000100:00080000:0.0:1789448153.302551:0:5826:0:(import.c:65:import_set_state_nolock()) 000000007919e122 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448153.302601:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f175107f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:3303:x1876372317274240:12345-0@lo:250: Request processed in 244us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448153.302618:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448153.302655:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789448153.302663:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1789448153.302670:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789448153.302673:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789448153.302676:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000584cc8ef MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789448153.302679:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789448153.302687:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789448153.302692:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046f5f811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317274240:0@lo:250: 00000100:00100000:3.0:1789448153.321176:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.323008:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789448153.323016:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789448153.324745:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789448153.324757:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789448153.325130:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789448153.325136:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789448153.325938:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.326107:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789448153.326113:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789448153.326705:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789448153.326712:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789448153.367436:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448153.367946:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789448153.367953:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789448153.369145:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789448153.369158:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789448153.370018:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.370206:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789448153.370211:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789448153.370993:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789448153.371058:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789448153.372323:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.372499:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789448153.372504:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789448153.374338:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789448153.374353:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789448153.376101:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.376370:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789448153.376377:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789448153.377188:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789448153.377198:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789448153.414949:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448153.415310:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789448153.415317:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789448153.416574:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789448153.416584:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789448153.418145:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789448153.418158:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789448153.419662:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789448153.419696:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789448153.419703:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789448153.419828:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789448153.419861:0:5814:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789448153.419865:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789448153.419867:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789448153.419872:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448153.419873:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448153.419874:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448153.419875:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448153.419876:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789448153.419877:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789448153.419879:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789448153.419880:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789448153.419881:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448153.419882:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789448153.419884:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789448153.419887:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789448153.419887:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789448153.419888:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448153.419889:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448153.419890:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448153.419891:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448153.419891:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789448153.419892:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789448153.419893:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789448153.419894:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789448153.419894:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448153.419895:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789448153.419921:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789448153.419940:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e3e9d63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274368:0@lo:253: 00000100:00100000:3.0:1789448153.420101:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.420196:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000269bf1d8 going to sleep for 11 seconds 00000100:00100000:1.0:1789448153.420440:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274368 00000100:00100000:1.0:1789448153.420447:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274368 00000100:00100000:1.0:1789448153.420545:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448153.420554:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3c8a66c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5814:x1876372317274368:12345-0@lo:253: 20000000:01000000:1.0:1789448153.420599:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789448153.420602:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789448153.420918:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789448153.420973:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789448153.421390:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789448153.422407:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789448153.422580:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789448153.422584:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789448153.422589:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789448153.422591:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789448153.422603:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789448153.422754:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448153.422969:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789448153.422981:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789448153.423043:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789448153.423092:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789448153.423129:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789448153.423210:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789448153.423424:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789448153.423489:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789448153.423497:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789448153.423529:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789448153.423535:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789448153.423560:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789448153.423622:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789448153.423653:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789448153.423657:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789448153.423670:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448153.423839:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789448153.423849:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789448153.423878:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789448153.423905:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789448153.423947:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789448153.423957:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789448153.424040:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789448153.424050:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789448153.424092:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789448153.424128:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789448153.424159:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789448153.424169:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789448153.424463:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789448153.424487:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789448153.424534:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789448153.424571:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789448153.424745:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789448153.424795:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789448153.424802:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789448153.428145:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789448153.429670:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789448153.429699:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.154@tcp for mdt 20000000:01000000:1.0:1789448153.429702:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:1.0:1789448153.429740:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789448153.429748:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789448153.429779:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789448153.429787:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:1.0:1789448153.429833:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789448153.429942:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789448153.430118:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789448153.430157:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789448153.430298:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789448153.430302:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789448153.430307:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789448153.430314:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789448153.430785:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789448153.431084:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789448153.445614:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789448153.445681:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789448153.445747:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789448153.445765:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789448153.445768:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789448153.445772:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789448153.445785:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789448153.445787:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789448153.445818:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789448153.445821:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789448153.448817:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789448153.452051:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789448153.452104:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789448153.452181:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1789448153.452194:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789448153.452197:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789448153.452792:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789448153.453501:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789448153.453543:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789448153.453570:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789448153.453582:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789448153.453584:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789448153.453596:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789448153.453615:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453631:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453641:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453647:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453653:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453659:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453665:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bbef5724 already unused, calling callback (00000000ba2006e0) 00010000:00010000:0.0:1789448153.453668:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453675:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453687:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453693:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.453699:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbef5724/0xe29566c2465f9477 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789448153.453719:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789448153.716688:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3c8a66c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5814:x1876372317274368:12345-0@lo:253: Request processed in 296128us (296581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448153.716704:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448153.716809:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e3e9d63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274368:0@lo:253: 10000000:01000000:0.0:1789448153.716824:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789448153.716827:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448153.716829:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448153.716830:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448153.716831:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789448153.716832:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448153.716834:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448153.716835:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448153.716836:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448153.716838:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789448153.716839:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448153.716840:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789448153.716859:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c0756062 from lustre-MDT0000 10000000:01000000:0.0:1789448153.716972:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789448153.716975:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789448153.716979:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97d9eaf63380 10000000:01000000:0.0:1789448153.716984:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448153.716993:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97d9eaf63380 from 1 10000000:01000000:0.0:1789448153.716995:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789448153.717044:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.717054:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.717062:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448153.717079:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007dbb2161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274496:0@lo:101: 00000100:00100000:0.0:1789448153.717124:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448153.717209:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000000030c2e6 going to sleep for 11 seconds 00000100:00100000:1.0:1789448153.717347:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274496 00000100:00100000:1.0:1789448153.717354:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274496 00000100:00100000:1.0:1789448153.717425:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448153.717433:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077d38472 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5814:x1876372317274496:12345-0@lo:101: 00010000:00010000:1.0:1789448153.717445:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448153.717458:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3718f13/0xe29566c2465f9485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f947e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448153.717555:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3718f13/0xe29566c2465f9485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f947e expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448153.717568:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3718f13/0xe29566c2465f9485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f947e expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448153.717576:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3718f13, rc 0) 00000100:00100000:1.0:1789448153.717614:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077d38472 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5814:x1876372317274496:12345-0@lo:101: Request processed in 182us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448153.717630:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448153.717695:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007dbb2161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274496:0@lo:101: 00010000:00010000:3.0:1789448153.717708:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.717716:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448153.717771:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274624:0@lo:501: 00000100:00100000:3.0:1789448153.717796:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.717884:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef196493 going to sleep for 11 seconds 00000100:00100000:0.0:1789448153.718011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274624 00000100:00100000:0.0:1789448153.718016:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274624 00000100:00100000:0.0:1789448153.718038:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448153.718043:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040654e2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5814:x1876372317274624:12345-0@lo:501: 00000100:00100000:0.0:1789448153.718294:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040654e2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5814:x1876372317274624:12345-0@lo:501: Request processed in 250us (498us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448153.718301:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448153.718385:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274624:0@lo:501: 10000000:01000000:3.0:1789448153.718408:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789448153.718425:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.718433:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000bbef5724/0xe29566c2465f947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448153.718442:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97d9c6cee800 10000000:01000000:3.0:1789448153.718446:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789448153.718449:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97d9c6cee800 10000000:01000000:3.0:1789448153.718451:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789448153.718453:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97d9c6cee800 from 1 10000000:01000000:3.0:1789448153.718455:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789448153.718485:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.718502:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.718510:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448153.718521:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274752:0@lo:101: 00000100:00100000:3.0:1789448153.718553:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.718571:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef196493 going to sleep for 11 seconds 00000100:00100000:0.0:1789448153.718685:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274752 00000100:00100000:0.0:1789448153.718690:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274752 00000100:00100000:0.0:1789448153.718708:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448153.718713:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bec0613e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5814:x1876372317274752:12345-0@lo:101: 00010000:00010000:0.0:1789448153.718721:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448153.718729:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffb970db/0xe29566c2465f9493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f948c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.718744:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffb970db/0xe29566c2465f9493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f948c expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.718752:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffb970db/0xe29566c2465f9493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f948c expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.718758:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffb970db, rc 0) 00000100:00100000:0.0:1789448153.718793:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bec0613e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:5814:x1876372317274752:12345-0@lo:101: Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448153.718800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448153.718868:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274752:0@lo:101: 00010000:00010000:3.0:1789448153.718950:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.718959:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448153.718969:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789448153.718981:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.718987:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000000ac41d2d/0xe29566c2465f948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448153.718992:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789448153.718995:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789448153.718999:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97d9c6cee800 10000000:01000000:3.0:1789448153.719001:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789448153.719004:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789448153.719005:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789448153.719017:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.719022:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.719029:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448153.719046:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274880:0@lo:101: 00000100:00100000:3.0:1789448153.719070:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.719081:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef196493 going to sleep for 11 seconds 00000100:00100000:0.0:1789448153.719136:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317274880 00000100:00100000:0.0:1789448153.719141:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317274880 00000100:00100000:0.0:1789448153.719162:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448153.719167:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec4791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:5814:x1876372317274880:12345-0@lo:101: 00010000:00010000:0.0:1789448153.719174:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448153.719180:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ad6d631/0xe29566c2465f94a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f949a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.719192:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ad6d631/0xe29566c2465f94a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f949a expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.719199:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ad6d631/0xe29566c2465f94a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f949a expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448153.719205:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ad6d631, rc 0) 00000100:00100000:0.0:1789448153.719256:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec4791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+8:5814:x1876372317274880:12345-0@lo:101: Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448153.719263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448153.719334:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317274880:0@lo:101: 00010000:00010000:3.0:1789448153.719343:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448153.719349:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448153.719386:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275008:0@lo:501: 00000100:00100000:3.0:1789448153.719408:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.719433:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef196493 going to sleep for 11 seconds 00000100:00100000:0.0:1789448153.719497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275008 00000100:00100000:0.0:1789448153.719502:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275008 00000100:00100000:0.0:1789448153.719518:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448153.719523:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040983bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+8:5814:x1876372317275008:12345-0@lo:501: 00000100:00100000:0.0:1789448153.719723:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040983bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5814:x1876372317275008:12345-0@lo:501: Request processed in 200us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448153.719730:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448153.719867:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275008:0@lo:501: 00000100:00100000:3.0:1789448153.719963:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275136:0@lo:503: 00000100:00100000:3.0:1789448153.720003:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.720021:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef196493 going to sleep for 11 seconds 00000100:00100000:1.0:1789448153.720098:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275136 00000100:00100000:1.0:1789448153.720104:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275136 00000100:00100000:1.0:1789448153.720126:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448153.720131:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001265b87c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5814:x1876372317275136:12345-0@lo:503: 00000100:00100000:1.0:1789448153.720293:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001265b87c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5814:x1876372317275136:12345-0@lo:503: Request processed in 162us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448153.720299:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448153.720381:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275136:0@lo:503: 00000100:00100000:3.0:1789448153.721024:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5856:1876372317275264:0@lo:502: 00000100:00100000:3.0:1789448153.721063:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448153.721127:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cd991eb going to sleep for 11 seconds 00000100:00100000:1.0:1789448153.721158:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275264 00000100:00100000:1.0:1789448153.721164:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275264 00000100:00100000:1.0:1789448153.721247:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789448153.721253:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016a3490c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5856:x1876372317275264:12345-0@lo:502: 00000100:00100000:1.0:1789448153.721402:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016a3490c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5856:x1876372317275264:12345-0@lo:502: Request processed in 149us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448153.721409:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448153.721772:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5856:1876372317275264:0@lo:502: 00000020:01000000:3.0:1789448153.721799:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448153.721810:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448153.721817:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789448153.721822:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789448153.721826:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448153.721840:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e0bba369) 00000020:00000080:3.0:1789448153.721857:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789448153.721862:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789448153.721949:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789448153.721956:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f94af 00000020:00000080:3.0:1789448153.722200:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789448153.722204:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448153.722208:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448153.722209:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789448153.722211:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448153.722235:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448153.722237:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789448153.722241:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448153.722248:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b9727693) 00000020:00000080:3.0:1789448153.722256:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789448153.722259:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789448153.722261:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789448153.722263:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789448153.722268:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448153.722303:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0756062 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789448153.722313:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000083ccc236) 00000020:00000080:3.0:1789448153.722320:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789448153.722362:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789448153.722374:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465f94c4 00000020:00000080:3.0:1789448153.722478:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789448153.722484:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789448153.722496:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe29566c2465f94cb 00080000:01000000:3.0:1789448153.722502:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789448153.722506:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f94d2 00080000:10000000:3.0:1789448153.722898:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789448153.723089:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789448153.728027:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789448153.798081:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789448153.798461:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789448153.801836:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789448153.802212:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789448153.848074:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000069a31887) 00000020:00000080:2.0:1789448153.848097:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789448153.848165:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789448153.848171:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f94e0 00000020:00000080:3.0:1789448153.849379:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789448153.854154:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789448153.906665:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448153.942784:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448153.977370:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448154.023211:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448154.063136:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789448154.092147:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe29566c2465f94e7 00000020:00000080:3.0:1789448154.092614:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789448154.092623:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448154.092629:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448154.092631:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789448154.092634:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448154.092639:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448154.092641:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789448154.092644:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789448154.092677:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789448154.092687:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448154.092690:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448154.092691:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789448154.092693:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448154.092695:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448154.092696:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448154.092699:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448154.092700:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789448154.092747:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5856:1876372317275392:0@lo:502: 00000100:00100000:3.0:1789448154.092833:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.092971:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cd991eb going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.093043:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275392 00000100:00100000:2.0:1789448154.093051:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275392 00000100:00100000:2.0:1789448154.093098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789448154.093107:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f988ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5856:x1876372317275392:12345-0@lo:502: 00000100:00100000:3.0:1789448154.093726:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f988ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5856:x1876372317275392:12345-0@lo:502: Request processed in 619us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448154.093740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789448154.093967:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c82c51b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5856:1876372317275392:0@lo:502: 00000020:01000000:2.0:1789448154.093993:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448154.093998:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448154.093999:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789448154.094003:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789448154.094156:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789448154.094182:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789448154.094205:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.094246:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000b7971a26/0xe29566c2465f949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448154.094255:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9c6cee800 from 1 10000000:01000000:3.0:1789448154.094258:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789448154.094284:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.094292:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.094301:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.094315:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275520:0@lo:101: 00000100:00100000:3.0:1789448154.094351:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.094374:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6ee89 going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.094622:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275520 00000100:00100000:2.0:1789448154.094628:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275520 00000100:00100000:2.0:1789448154.094662:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789448154.094669:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008c6e68f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:5814:x1876372317275520:12345-0@lo:101: 00010000:00010000:2.0:1789448154.094680:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448154.094694:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f94ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.094716:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f94ee expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.094727:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f94ee expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.094735:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c04e93fc, rc 0) 00000100:00100000:2.0:1789448154.094779:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008c6e68f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:5814:x1876372317275520:12345-0@lo:101: Request processed in 111us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.094786:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448154.094867:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275520:0@lo:101: 00010000:00010000:3.0:1789448154.094952:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.094962:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.095745:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275648:0@lo:256: 00000100:00100000:3.0:1789448154.095808:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.095848:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6ee89 going to sleep for 11 seconds 00000100:00100000:1.0:1789448154.095985:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275648 00000100:00100000:1.0:1789448154.095992:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275648 00000100:00100000:1.0:1789448154.096025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448154.096031:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dfb2f40f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:5814:x1876372317275648:12345-0@lo:256: 20000000:01000000:1.0:1789448154.096048:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789448154.096054:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789448154.096118:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dfb2f40f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:5814:x1876372317275648:12345-0@lo:256: Request processed in 87us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448154.096125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448154.096361:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275648:0@lo:256: 10000000:01000000:3.0:1789448154.097401:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789448154.097593:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.097605:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448154.097612:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c6cee800 from 1 10000000:01000000:3.0:1789448154.097615:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448154.097651:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.097658:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.097667:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.097685:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275776:0@lo:101: 00000100:00100000:3.0:1789448154.097737:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.097778:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6ee89 going to sleep for 11 seconds 00000100:00100000:0.0:1789448154.097836:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275776 00000100:00100000:0.0:1789448154.097844:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275776 00000100:00100000:0.0:1789448154.097960:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789448154.097967:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000979c2c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:5814:x1876372317275776:12345-0@lo:101: 00010000:00010000:0.0:1789448154.097989:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448154.098002:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f94fc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448154.098022:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f94fc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448154.098030:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f94fc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448154.098037:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036fe4da0, rc 0) 00000100:00100000:0.0:1789448154.098116:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000979c2c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317275776:12345-0@lo:101: Request processed in 150us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448154.098123:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448154.098581:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275776:0@lo:101: 00010000:00010000:3.0:1789448154.098595:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.098603:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.098667:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275904:0@lo:501: 00000100:00100000:3.0:1789448154.098698:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.098795:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6ee89 going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.098837:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317275904 00000100:00100000:2.0:1789448154.098842:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317275904 00000100:00100000:2.0:1789448154.098981:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448154.098989:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000548a2122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317275904:12345-0@lo:501: 00000100:00100000:2.0:1789448154.099746:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000548a2122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317275904:12345-0@lo:501: Request processed in 757us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.099762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448154.100121:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317275904:0@lo:501: 00000100:00100000:3.0:1789448154.100167:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276032:0@lo:503: 00000100:00100000:3.0:1789448154.100212:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.100303:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6ee89 going to sleep for 11 seconds 00000100:00100000:1.0:1789448154.100607:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276032 00000100:00100000:1.0:1789448154.100620:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276032 00000100:00100000:1.0:1789448154.100660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789448154.100667:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b9c444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317276032:12345-0@lo:503: 00000040:00080000:1.0:1789448154.100710:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448154.100841:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b9c444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317276032:12345-0@lo:503: Request processed in 175us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448154.100849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448154.100992:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276032:0@lo:503: 00000040:00080000:0.0:1789448154.102114:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789448154.102562:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789448154.102589:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448154.102612:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.102625:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448154.102668:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789448154.102671:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97d9c6cee800 10000000:01000000:3.0:1789448154.102674:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97d9c6cee800 10000000:01000000:3.0:1789448154.102678:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789448154.102683:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c6cee800 from 1 10000000:01000000:3.0:1789448154.102686:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789448154.102726:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.102733:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.102755:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.102774:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276160:0@lo:101: 00000100:00100000:3.0:1789448154.102832:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.103025:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe5b4918 going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.103070:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276160 00000100:00100000:2.0:1789448154.103079:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276160 00000100:00100000:2.0:1789448154.103160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448154.103173:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025d29c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317276160:12345-0@lo:101: 00010000:00010000:2.0:1789448154.103185:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448154.103197:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000409c0557/0xe29566c2465f9511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f950a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.103250:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000409c0557/0xe29566c2465f9511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.103261:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000409c0557/0xe29566c2465f9511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.103269:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000409c0557, rc 0) 00000100:00100000:2.0:1789448154.103317:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025d29c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276160:12345-0@lo:101: Request processed in 148us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.103323:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789448154.103403:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276160:0@lo:101: 00010000:00010000:3.0:1789448154.103427:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.103436:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.103497:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276288:0@lo:501: 00000100:00100000:3.0:1789448154.103524:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.103775:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe5b4918 going to sleep for 11 seconds 00000100:00100000:0.0:1789448154.103836:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276288 00000100:00100000:0.0:1789448154.103842:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276288 00000100:00100000:0.0:1789448154.103865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789448154.103944:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000357cbc86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276288:12345-0@lo:501: 00000100:00100000:0.0:1789448154.104238:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000357cbc86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276288:12345-0@lo:501: Request processed in 365us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448154.104245:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789448154.104323:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276288:0@lo:501: 00000100:00100000:3.0:1789448154.104352:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276416:0@lo:503: 00000100:00100000:3.0:1789448154.104390:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.104419:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe5b4918 going to sleep for 11 seconds 00000100:00100000:0.0:1789448154.104580:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276416 00000100:00100000:0.0:1789448154.104584:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276416 00000100:00100000:0.0:1789448154.104603:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448154.104607:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008af92139 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276416:12345-0@lo:503: 00000100:00100000:0.0:1789448154.104973:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008af92139 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276416:12345-0@lo:503: Request processed in 364us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448154.104989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448154.105060:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276416:0@lo:503: 00000100:00100000:3.0:1789448154.105857:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5861:1876372317276544:0@lo:502: 00000100:00100000:3.0:1789448154.105982:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.106015:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4da958a going to sleep for 11 seconds 00000100:00100000:0.0:1789448154.106057:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276544 00000100:00100000:0.0:1789448154.106063:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276544 00000100:00100000:0.0:1789448154.106096:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448154.106103:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a731bc1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5861:x1876372317276544:12345-0@lo:502: 00000100:00100000:0.0:1789448154.106378:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a731bc1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5861:x1876372317276544:12345-0@lo:502: Request processed in 275us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448154.106385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448154.106658:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5861:1876372317276544:0@lo:502: 00000020:01000004:3.0:1789448154.106721:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789448154.106746:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000068ce1fa2) 00000020:00000080:3.0:1789448154.106778:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789448154.107042:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0756062 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789448154.107046:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c0756062 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789448154.107048:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c0756062 4 00010000:00080000:3.0:1789448154.107076:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000008c172@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789448154.110687:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789448154.110996:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789448154.111032:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789448154.111045:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe29566c2465f951f 00000100:00080000:3.0:1789448154.111055:0:5861:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448154.111064:0:5861:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000008c172 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448154.111099:0:5861:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000e7abf15 x1876372317276672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448154.111129:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789448154.111319:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317276672:0@lo:38: 00000100:00100000:2.0:1789448154.111395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448154.111639:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b6e2484 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5861:1876372317276800:0@lo:502: 00000100:00100000:2.0:1789448154.111676:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448154.111700:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276800 00000100:00100000:2.0:1789448154.111706:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276800 00000100:00100000:2.0:1789448154.111739:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448154.111745:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000698d780b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5861:x1876372317276800:12345-0@lo:502: 00000100:00100000:2.0:1789448154.112026:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000698d780b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5861:x1876372317276800:12345-0@lo:502: Request processed in 280us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.112033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448154.112121:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b501ebe9 going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.112137:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b6e2484 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5861:1876372317276800:0@lo:502: 00000040:00080000:2.0:1789448154.112159:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1789448154.112309:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276672 00000100:00100000:3.0:1789448154.112314:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276672 00000100:00100000:3.0:1789448154.112336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448154.112340:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000112cf4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317276672:12345-0@lo:38: 00000100:00100000:3.0:1789448154.112389:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000112cf4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317276672:12345-0@lo:38: Request processed in 48us (995us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789448154.112395:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448154.112567:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448154.112574:0:3303:0:(import.c:65:import_set_state_nolock()) 000000000008c172 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448154.112578:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789448154.112581:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e7abf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317276672:0@lo:38: 00000020:01000000:0.0:1789448154.112718:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789448154.112736:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448154.112755:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448154.112766:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000008c88cf2c/0xe29566c2465f950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789448154.112810:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789448154.112812:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448154.112814:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448154.112815:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448154.112816:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448154.112817:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448154.112820:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448154.112822:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448154.112823:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448154.112824:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448154.112825:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448154.112826:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448154.112829:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789448154.112832:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789448154.112833:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448154.112834:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448154.112838:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448154.112839:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448154.112840:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448154.112840:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448154.112841:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448154.112842:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448154.112843:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448154.112843:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448154.112844:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448154.112861:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789448154.112974:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276928:0@lo:253: 00000100:00100000:0.0:1789448154.113008:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448154.113038:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e764c4c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.113109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317276928 00000100:00100000:2.0:1789448154.113113:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317276928 00000100:00100000:2.0:1789448154.113144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448154.113150:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f53ff9f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5814:x1876372317276928:12345-0@lo:253: 20000000:01000000:2.0:1789448154.113167:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789448154.113179:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789448154.149638:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789448154.149651:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789448154.151827:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789448154.151836:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789448154.151859:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.151888:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f94ee expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.151909:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.151949:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.151965:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.151980:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008577555c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317277056:0@lo:104: 00000100:00100000:3.0:1789448154.152051:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.152106:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000009188b0bf going to sleep for 11 seconds 00000100:00100000:2.0:1789448154.152253:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277056 00000100:00100000:2.0:1789448154.152261:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277056 00000100:00100000:2.0:1789448154.152304:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448154.152313:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b130d54f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317277056:12345-0@lo:104: 00010000:00010000:2.0:1789448154.152325:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448154.152387:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789448154.152392:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b130d54f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317277056:12345-0@lo:104: Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.152406:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448154.152517:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008577555c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317277056:0@lo:104: 00010000:00010000:1.0:1789448154.152534:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152723:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448154.152729:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152737:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002319fc94 already unused, calling callback (0000000040b58af2) 10000000:00010000:3.0:1789448154.152740:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152748:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448154.152754:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448154.152760:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789448154.152793:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152813:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448154.152829:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152836:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 000000002319fc94/0xe29566c2465f94ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.152850:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448154.152852:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448154.152854:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448154.153087:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d61c0a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317277184:0@lo:103: 00000100:00100000:1.0:1789448154.153135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448154.153289:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277184 00000100:00100000:3.0:1789448154.153295:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277184 00010000:00010000:3.0:1789448154.153312:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448154.153406:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448154.153423:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1170d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3305:x1876372317277184:12345-0@lo:103: 00010000:00010000:3.0:1789448154.153434:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448154.153439:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153450:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153471:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c04e93fc/0xe29566c2465f94f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f94ee expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153492:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153510:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789448154.153523:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001687361s 00010000:00010000:3.0:1789448154.153527:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153534:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153540:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153547:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153552:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000322a8c37 already unused, calling callback (00000000ba2006e0) 00010000:00010000:3.0:1789448154.153555:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153561:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153582:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448154.153592:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448154.153625:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1170d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3305:x1876372317277184:12345-0@lo:103: Request processed in 204us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448154.153632:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789448154.153679:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448154.153686:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448154.153691:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000322a8c37/0xe29566c2465f9526 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448154.153719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d61c0a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317277184:0@lo:103: 00000100:00100000:2.0:1789448154.160649:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f53ff9f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5814:x1876372317276928:12345-0@lo:253: Request processed in 47491us (47632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448154.160667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789448154.160772:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5814:1876372317276928:0@lo:253: 10000000:01000000:0.0:1789448154.160786:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789448154.160790:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448154.160792:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448154.160793:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448154.160794:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448154.160796:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448154.160797:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448154.160798:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448154.160799:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448154.160801:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448154.160802:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448154.160803:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448154.160804:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789448154.160820:0:5814:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789448154.169634:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.170095:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448154.170342:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.170625:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448154.170825:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.171069:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448154.171948:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.172149:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448154.172366:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.172648:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448154.172848:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448154.173104:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789448154.222429:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:2.0:1789448154.266642:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789448154.266977:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789448154.267282:0:5866:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789448154.267286:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789448154.267638:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789448154.276192:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789448154.277281:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789448154.279107:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789448154.279866:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789448154.281502:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448154.282801:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789448154.284141:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789448154.284199:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789448154.284754:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789448154.285380:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789448154.287141:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789448154.287622:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789448154.287765:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789448154.288801:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789448154.289140:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789448154.289863:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789448154.290720:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789448154.291829:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789448154.292387:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789448154.292687:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789448154.292819:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789448154.293664:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789448154.293827:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789448154.295843:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789448154.296695:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789448154.301003:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789448154.301835:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789448154.302889:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789448154.303029:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789448154.303136:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789448154.303260:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789448154.303390:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789448154.303793:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789448154.303949:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789448154.304174:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789448154.304473:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789448154.304690:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789448154.304864:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789448154.304998:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789448154.305704:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789448154.305837:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789448154.305999:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789448154.307206:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789448154.319499:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789448154.368910:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789448154.368945:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8ae81c97988 00100000:10000000:1.0:1789448154.368952:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789448154.369711:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789448154.369726:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789448154.369739:0:5814:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789448154.369754:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789448154.427614:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789448154.427711:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789448154.427717:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789448155.289622:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448156.314477:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448157.338834:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448158.362831:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789448158.498729:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789448158.498736:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9c6cee800 from 3 10000000:01000000:0.0:1789448158.498741:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789448158.498786:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448158.498798:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448158.498808:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448158.498830:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317277312:0@lo:101: 00000100:00100000:0.0:1789448158.498896:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448158.498960:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ac660c5 going to sleep for 11 seconds 00000100:00100000:1.0:1789448158.499037:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277312 00000100:00100000:1.0:1789448158.499053:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277312 00000100:00100000:1.0:1789448158.499116:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789448158.499124:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd2fbef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5831:x1876372317277312:12345-0@lo:101: 00010000:00010000:1.0:1789448158.499137:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448158.499150:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5efb888/0xe29566c2465f9534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f952d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448158.499170:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5efb888/0xe29566c2465f9534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f952d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448158.499180:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5efb888/0xe29566c2465f9534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f952d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448158.499188:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5efb888, rc 0) 00000100:00100000:1.0:1789448158.499279:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd2fbef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317277312:12345-0@lo:101: Request processed in 156us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448158.499285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448158.499444:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317277312:0@lo:101: 00010000:00010000:0.0:1789448158.499459:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448158.499474:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448158.499521:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317277440:0@lo:256: 00000100:00100000:0.0:1789448158.499565:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448158.499595:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ac660c5 going to sleep for 11 seconds 00000100:00100000:1.0:1789448158.499809:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277440 00000100:00100000:1.0:1789448158.499814:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277440 00000100:00100000:1.0:1789448158.499843:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789448158.499850:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cbbef6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317277440:12345-0@lo:256: 20000000:01000000:1.0:1789448158.499862:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789448158.499878:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789448158.499881:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789448158.499952:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cbbef6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317277440:12345-0@lo:256: Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448158.499959:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789448158.500036:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317277440:0@lo:256: 10000000:01000000:0.0:1789448158.500076:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448158.500081:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448158.500090:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000002d232998/0xe29566c2465f952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448159.385991:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789448159.513674:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789448159.513684:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789448159.513687:0:477:0:(import.c:65:import_set_state_nolock()) 000000000008c172 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448159.513705:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000008c172 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448159.513727:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000edd733c7 x1876372317277696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448159.513817:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448159.513833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014cfa3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317277568:0@lo:400: 00000100:00100000:3.0:1789448159.513911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448159.513967:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277568 00000100:00100000:3.0:1789448159.513976:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277568 00000100:00100000:3.0:1789448159.514017:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448159.514025:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000283ddeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3307:x1876372317277568:12345-0@lo:400: 00000100:00100000:3.0:1789448159.514074:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000283ddeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3307:x1876372317277568:12345-0@lo:400: Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448159.514081:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448159.514128:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014cfa3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317277568:0@lo:400: 00000100:00100000:3.0:1789448159.514154:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edd733c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317277696:0@lo:38: 00000100:00100000:3.0:1789448159.514248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448159.514478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277696 00000100:00100000:0.0:1789448159.514484:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277696 00000100:00100000:0.0:1789448159.514514:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448159.514518:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014cfa3f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876372317277696:12345-0@lo:38: 00010000:00080000:0.0:1789448159.514539:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1789448159.514570:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe29566c2465f953b 00000004:00100000:0.0:1789448159.514611:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789448159.514736:0:5835:0:(import.c:65:import_set_state_nolock()) 0000000024d96674 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448159.514780:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014cfa3f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876372317277696:12345-0@lo:38: Request processed in 261us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448159.514787:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448159.514818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000edd733c7 x1876372317277696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789448159.514839:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789448159.514846:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789448159.514850:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789448159.514852:0:3303:0:(import.c:65:import_set_state_nolock()) 000000000008c172 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789448159.514857:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edd733c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317277696:0@lo:38: 00000001:02000400:3.0:1789448159.629198:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789448160.410758:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448161.434349:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448162.457974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448163.485487:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448164.507916:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448164.638382:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448164.638407:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317277824:0@lo:400: 00000100:00100000:0.0:1789448164.638476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448164.639748:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277824 00000100:00100000:2.0:1789448164.639759:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277824 00000100:00100000:2.0:1789448164.639799:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448164.639812:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb87eb10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3306:x1876372317277824:12345-0@lo:400: 00000100:00100000:2.0:1789448164.639873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb87eb10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3306:x1876372317277824:12345-0@lo:400: Request processed in 62us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448164.639878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448164.639918:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c69b554 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317277824:0@lo:400: 00000100:00100000:1.0:1789448164.641075:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033cf78b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317277952:0@lo:400: 00000100:00100000:1.0:1789448164.641426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448164.646675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317277952 00000100:00100000:3.0:1789448164.646692:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317277952 00000100:00100000:3.0:1789448164.646753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448164.646762:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fbc01a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317277952:12345-0@lo:400: 00000100:00100000:3.0:1789448164.646855:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fbc01a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317277952:12345-0@lo:400: Request processed in 95us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448164.646863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789448164.646922:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000033cf78b8 x1876372317277952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448164.646938:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033cf78b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317277952:0@lo:400: 00000020:00000080:2.0:1789448164.750840:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeee339470 20000000:00000080:2.0:1789448164.750857:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d9c608e400 uarg=0000000000000000 20000000:01000000:2.0:1789448164.750891:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789448164.750898:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789448164.750903:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789448164.752478:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789448164.752502:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789448164.764944:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448164.766849:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789448164.767034:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789448164.767132:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789448164.767157:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789448164.767184:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.767551:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f94fc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.767558:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.767609:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.767628:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 11 pid: 5828 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448164.767662:0:6312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b6e2484 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1876372317278080:0@lo:104: 00000100:00100000:2.0:1789448164.767747:0:6312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448164.768717:0:6312:0:(client.c:2716:ptlrpc_set_wait()) set 000000000de21e6d going to sleep for 11 seconds 00000100:00100000:3.0:1789448164.770965:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278080 00000100:00100000:3.0:1789448164.770989:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278080 00000100:00100000:3.0:1789448164.773033:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448164.773080:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f30a5429 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:6312:x1876372317278080:12345-0@lo:104: 00010000:00010000:3.0:1789448164.773114:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448164.773280:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448164.773287:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f30a5429 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:6312:x1876372317278080:12345-0@lo:104: Request processed in 229us (5541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448164.773296:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448164.773401:0:6312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b6e2484 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1876372317278080:0@lo:104: 00010000:00010000:0.0:1789448164.773435:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773568:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448164.773575:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773584:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000339fcee5 already unused, calling callback (0000000040b58af2) 10000000:00010000:1.0:1789448164.773587:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773595:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448164.773601:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448164.773606:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789448164.773664:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773670:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448164.773693:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773700:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 00000000339fcee5/0xe29566c2465f94fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9503 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448164.773720:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448164.773722:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448164.773724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448164.773737:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e88596e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317278208:0@lo:103: 00000100:00100000:1.0:1789448164.773801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448164.773928:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278208 00000100:00100000:2.0:1789448164.773939:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278208 00010000:00010000:2.0:1789448164.773973:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 12 pid: 5828 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448164.774012:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448164.774019:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b1ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3305:x1876372317278208:12345-0@lo:103: 00010000:00010000:2.0:1789448164.774033:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448164.774261:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 12 pid: 5828 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774279:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 12 pid: 5828 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774299:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036fe4da0/0xe29566c2465f9503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f94fc expref: 12 pid: 5828 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774319:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774327:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774344:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774385:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774391:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774397:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774404:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c04e93fc already unused, calling callback (00000000ba2006e0) 00010000:00010000:2.0:1789448164.774407:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.774415:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448164.774705:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448164.774715:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.776934:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.776959:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c04e93fc/0xe29566c2465f9542 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448164.776989:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448164.777668:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b1ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:3305:x1876372317278208:12345-0@lo:103: Request processed in 3643us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448164.777697:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448164.777881:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e88596e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317278208:0@lo:103: 00010000:00010000:2.0:1789448165.529602:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448166.554982:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448167.581115:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789448167.963453:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789448167.963461:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c6cee800 from 1 10000000:01000000:0.0:1789448167.963466:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448167.963510:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000280b9b69/0xe29566c2465f9549 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448167.963524:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000280b9b69/0xe29566c2465f9549 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448167.963536:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000280b9b69/0xe29566c2465f9549 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448167.963575:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006509546a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278336:0@lo:101: 00000100:00100000:0.0:1789448167.963656:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448167.963715:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044b77a64 going to sleep for 11 seconds 00000100:00100000:1.0:1789448167.964171:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278336 00000100:00100000:1.0:1789448167.964180:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278336 00000100:00100000:1.0:1789448167.964239:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789448167.964246:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076aeda0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:5831:x1876372317278336:12345-0@lo:101: 00010000:00010000:1.0:1789448167.964259:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448167.964271:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce198e32/0xe29566c2465f9550 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9549 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448167.964293:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce198e32/0xe29566c2465f9550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9549 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448167.964302:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce198e32/0xe29566c2465f9550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9549 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448167.964321:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce198e32, rc 0) 00000100:00100000:1.0:1789448167.964378:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076aeda0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317278336:12345-0@lo:101: Request processed in 133us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448167.964385:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789448167.964426:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006509546a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278336:0@lo:101: 00010000:00010000:1.0:1789448167.964439:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000280b9b69/0xe29566c2465f9549 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448167.964447:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000280b9b69/0xe29566c2465f9549 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448167.964493:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014d0191a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278464:0@lo:501: 00000100:00100000:1.0:1789448167.964514:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448167.964528:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000009344843a going to sleep for 11 seconds 00000100:00100000:2.0:1789448167.964787:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278464 00000100:00100000:2.0:1789448167.964792:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278464 00000100:00100000:2.0:1789448167.964812:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789448167.964817:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053a1cc93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317278464:12345-0@lo:501: 00000100:00100000:2.0:1789448167.965135:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053a1cc93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317278464:12345-0@lo:501: Request processed in 317us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448167.965142:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789448167.965196:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014d0191a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278464:0@lo:501: 00000100:00100000:2.0:1789448167.965240:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000735e5df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278592:0@lo:503: 00000100:00100000:2.0:1789448167.965272:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448167.965290:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d50a05a going to sleep for 11 seconds 00000100:00100000:2.0:1789448167.965299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278592 00000100:00100000:2.0:1789448167.965302:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278592 00000100:00100000:2.0:1789448167.965435:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448167.965441:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f83e2ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317278592:12345-0@lo:503: 00000100:00100000:2.0:1789448167.965545:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f83e2ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317278592:12345-0@lo:503: Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448167.965551:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448167.965583:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000735e5df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317278592:0@lo:503: 00000100:00100000:2.0:1789448167.968022:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000735e5df pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6509:1876372317278720:0@lo:502: 00000100:00100000:2.0:1789448167.968097:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448167.968130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278720 00000100:00100000:2.0:1789448167.968137:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278720 00000100:00100000:2.0:1789448167.968176:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789448167.968184:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c52ff5d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6509:x1876372317278720:12345-0@lo:502: 00000100:00100000:2.0:1789448167.968743:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c52ff5d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6509:x1876372317278720:12345-0@lo:502: Request processed in 558us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448167.968752:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789448167.968816:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d50a05a going to sleep for 11 seconds 00000100:00100000:2.0:1789448167.968845:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000735e5df pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6509:1876372317278720:0@lo:502: 00000020:01000000:2.0:1789448167.968875:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448167.968884:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448167.968886:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789448167.968892:0:6509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9c6cee800 00000020:00000080:2.0:1789448167.968894:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789448167.968937:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6509:1876372317278848:0@lo:502: 00000100:00100000:2.0:1789448167.968975:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448167.969088:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278848 00000100:00100000:2.0:1789448167.969093:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278848 00000100:00100000:2.0:1789448167.969120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789448167.969127:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6509:x1876372317278848:12345-0@lo:502: 00000100:00100000:2.0:1789448167.969250:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6509:x1876372317278848:12345-0@lo:502: Request processed in 124us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448167.969257:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789448167.969285:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d2e37300 going to sleep for 11 seconds 00000100:00100000:2.0:1789448167.969297:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6509:1876372317278848:0@lo:502: 00000020:01000000:2.0:1789448167.972071:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448167.972084:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448167.972086:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789448167.972092:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789448167.972846:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789448167.972872:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448167.972884:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448167.972896:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.614749:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448169.626852:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448169.758014:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448169.758039:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317278976:0@lo:400: 00000100:00100000:0.0:1789448169.758109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448169.758200:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317279104:0@lo:400: 00000100:00100000:0.0:1789448169.758241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448169.758279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279104 00000100:00100000:0.0:1789448169.758288:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279104 00000100:00100000:0.0:1789448169.758364:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448169.758373:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317279104:12345-0@lo:400: 00000100:00100000:0.0:1789448169.758426:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317279104:12345-0@lo:400: Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448169.758433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448169.758469:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9fb0b0700 x1876372317279104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448169.758482:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317279104:0@lo:400: 00000100:00100000:2.0:1789448169.759769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317278976 00000100:00100000:2.0:1789448169.759790:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317278976 00000100:00100000:2.0:1789448169.760283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789448169.760295:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3307:x1876372317278976:12345-0@lo:400: 00000100:00100000:2.0:1789448169.760455:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3307:x1876372317278976:12345-0@lo:400: Request processed in 162us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448169.760473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448169.761064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317278976:0@lo:400: 00010000:00010000:3.0:1789448170.649584:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448171.673957:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789448172.038073:0:6668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789448172.038078:0:6668:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789448172.039734:0:6668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97d9c336e800 00000020:01000004:0.0:1789448172.039754:0:6668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789448172.039766:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789448172.039790:0:6668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97d9ceaa8000) 00000020:00000080:0.0:1789448172.039807:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789448172.092979:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789448172.093263:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789448172.173730:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789448172.189552:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789448172.189590:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789448172.189647:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789448172.189675:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789448172.190029:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789448172.190039:0:6668:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789448172.190049:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe29566c2465f955e 00000020:01000004:0.0:1789448172.190058:0:6668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789448172.190079:0:6668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789448172.190082:0:6668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789448172.190088:0:6668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789448172.190092:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789448172.190103:0:6668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97d9ceaacd40) 00000020:00000080:0.0:1789448172.190113:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789448172.193798:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448172.193975:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789448172.193982:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789448172.197391:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789448172.197405:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789448172.199945:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789448172.199956:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789448172.207953:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448172.208156:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789448172.208163:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789448172.220741:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789448172.220757:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789448172.250940:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448172.251192:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789448172.251199:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789448172.258316:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789448172.258341:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789448172.261819:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789448172.261832:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789448172.268671:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448172.268877:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448172.268884:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789448172.270452:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789448172.270463:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789448172.344703:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448172.344894:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448172.344901:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789448172.351506:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789448172.355511:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789448172.356167:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789448172.356191:0:6668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789448172.356197:0:6668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789448172.398139:0:6668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789448172.398198:0:6668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789448172.398204:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789448172.398206:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448172.398208:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448172.398210:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448172.398211:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448172.398213:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448172.398214:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448172.398232:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789448172.398233:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789448172.398235:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448172.398237:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448172.398241:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789448172.398244:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448172.398245:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448172.398247:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448172.398248:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448172.398249:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448172.398251:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448172.398252:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448172.398259:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789448172.398260:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789448172.398261:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448172.398262:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448172.398322:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789448172.398349:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317279232:0@lo:253: 00000100:00100000:2.0:1789448172.398446:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.398604:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c60886c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.401784:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279232 00000100:00100000:0.0:1789448172.401838:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279232 00000100:00100000:0.0:1789448172.401913:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789448172.401924:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317279232:12345-0@lo:253: 20000000:01000000:0.0:1789448172.402129:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789448172.402135:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789448172.402141:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789448172.402145:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789448172.404052:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448172.404360:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789448172.404376:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789448172.404419:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789448172.404427:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789448172.404456:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789448172.404527:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789448172.404929:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789448172.404951:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789448172.404953:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789448172.409471:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789448172.409506:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789448172.409606:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789448172.409616:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789448172.409652:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789448172.409663:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789448172.409696:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789448172.409788:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789448172.411790:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789448172.411831:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789448172.411834:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789448172.411872:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789448172.411881:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789448172.411913:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789448172.411930:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789448172.412093:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789448172.412105:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789448172.412155:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789448172.412192:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789448172.412212:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789448172.420301:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789448172.420323:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789448172.420328:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789448172.420331:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789448172.420364:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789448172.420368:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789448172.420446:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789448172.420450:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789448172.430343:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789448172.430463:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789448172.430519:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789448172.431085:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789448172.431129:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789448172.431190:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789448172.431204:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789448172.431208:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789448172.437321:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789448172.437471:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789448172.437527:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789448172.437928:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789448172.437968:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789448172.437996:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789448172.438016:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789448172.438019:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789448172.438563:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789448172.438795:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789448172.438836:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789448172.438898:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1789448172.438921:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789448172.438947:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.438970:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f947e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.438978:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f949a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.438984:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.438991:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.439041:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.439066:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.439084:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279360:0@lo:104: 00000100:00100000:2.0:1789448172.439166:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448172.439270:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.439280:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 12 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.439289:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279488:0@lo:104: 00000100:00100000:2.0:1789448172.439331:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448172.439356:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.439364:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 12 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.439372:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279616:0@lo:104: 00000100:00100000:2.0:1789448172.439389:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.439397:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c6088300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.439471:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279360 00000100:00100000:0.0:1789448172.439480:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279360 00000100:00100000:0.0:1789448172.439519:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279488 00000100:00100000:0.0:1789448172.439522:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279488 00000100:00100000:0.0:1789448172.439532:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279616 00000100:00100000:0.0:1789448172.439535:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279616 00000100:00100000:0.0:1789448172.439548:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448172.439558:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5828:x1876372317279360:12345-0@lo:104: 00010000:00010000:0.0:1789448172.439575:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.439651:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448172.439665:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5828:x1876372317279360:12345-0@lo:104: Request processed in 108us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.439673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448172.439693:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448172.439699:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:5828:x1876372317279488:12345-0@lo:104: 00010000:00010000:0.0:1789448172.439706:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.439746:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789448172.439751:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:5828:x1876372317279488:12345-0@lo:104: Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.439757:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448172.439769:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448172.439775:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5828:x1876372317279616:12345-0@lo:104: 00010000:00010000:0.0:1789448172.439782:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.439806:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789448172.439811:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5828:x1876372317279616:12345-0@lo:104: Request processed in 37us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.439817:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789448172.439884:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789448172.439892:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.439900:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448172.439904:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.439913:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448172.439921:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.439928:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789448172.439966:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.439973:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448172.439994:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440001:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f950a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9511 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440017:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448172.440020:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440036:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523e00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448172.440040:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440046:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448172.440052:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.440056:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789448172.440070:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440076:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448172.440081:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440088:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523e00/0xe29566c2465f949a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f94a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440097:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448172.440100:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440106:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031a00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448172.440109:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440126:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448172.440132:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.440138:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789448172.440159:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440164:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448172.440178:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440185:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c0031a00/0xe29566c2465f947e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440200:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448172.440201:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448172.440203:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448172.440209:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448172.440249:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317279744:0@lo:103: 00000100:00100000:1.0:1789448172.440285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.440329:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448172.440335:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317279872:0@lo:103: 00000100:00100000:1.0:1789448172.440354:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.440377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317280000:0@lo:103: 00000100:00100000:1.0:1789448172.440396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.440432:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279744 00000100:00100000:1.0:1789448172.440437:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279744 00010000:00010000:1.0:1789448172.440458:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 13 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.440473:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317279872 00000100:00100000:1.0:1789448172.440475:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317279872 00010000:00010000:1.0:1789448172.440484:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.440493:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280000 00000100:00100000:1.0:1789448172.440496:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280000 00010000:00010000:1.0:1789448172.440505:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 15 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.440516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448172.440522:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3304:x1876372317279744:12345-0@lo:103: 00010000:00010000:1.0:1789448172.440533:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448172.440538:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 15 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440549:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 15 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440566:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448172.440592:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3304:x1876372317279744:12345-0@lo:103: Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.440598:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448172.440612:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448172.440618:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3304:x1876372317279872:12345-0@lo:103: 00010000:00010000:1.0:1789448172.440626:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448172.440635:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440644:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 14 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440653:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448172.440673:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3304:x1876372317279872:12345-0@lo:103: Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.440679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448172.440689:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448172.440694:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3306:x1876372317280000:12345-0@lo:103: 00010000:00010000:1.0:1789448172.440701:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448172.440704:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 13 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440712:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 13 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440724:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440733:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440749:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440758:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440765:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440778:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440784:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a0400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448172.440788:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440796:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440805:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.440823:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448172.440851:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3306:x1876372317280000:12345-0@lo:103: Request processed in 155us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.440857:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448172.440897:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317280000:0@lo:103: 00000100:00100000:1.0:1789448172.440918:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317279872:0@lo:103: 00000100:00100000:1.0:1789448172.440924:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317279744:0@lo:103: 00010000:00010000:2.0:1789448172.441066:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c13a1a00/0xe29566c2465f9511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f950a expref: 12 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.441078:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279360:0@lo:104: 00010000:00010000:2.0:1789448172.441089:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f94a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f949a expref: 11 pid: 5826 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.441109:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279488:0@lo:104: 00010000:00010000:2.0:1789448172.441121:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f947e expref: 10 pid: 5827 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.441131:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876372317279616:0@lo:104: 00010000:00010000:2.0:1789448172.441149:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.441159:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.441165:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.441172:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f956c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789448172.441189:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789448172.531049:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:6668:x1876372317279232:12345-0@lo:253: Request processed in 129109us (132585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.531067:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789448172.531277:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317279232:0@lo:253: 10000000:01000000:2.0:1789448172.531307:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789448172.531467:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789448172.531469:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448172.531471:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448172.531472:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789448172.531473:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448172.531475:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448172.531477:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448172.531478:0:6668:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789448172.531480:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448172.531482:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789448172.531529:0:6668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97d9c336e800 from lustre-OST0000 10000000:01000000:2.0:1789448172.531563:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789448172.531566:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789448172.531575:0:6668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97d9eaf63380 local copy 10000000:01000000:2.0:1789448172.531580:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789448172.531633:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.531646:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.531656:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.531679:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280128:0@lo:101: 00000100:00100000:2.0:1789448172.531723:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.531784:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.531843:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280128 00000100:00100000:0.0:1789448172.531851:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280128 00000100:00100000:0.0:1789448172.531899:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448172.531909:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:6668:x1876372317280128:12345-0@lo:101: 00010000:00010000:0.0:1789448172.531923:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448172.531938:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f957a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9573 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.531979:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9573 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.531991:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9573 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.532002:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c0031e00, rc 0) 00000100:00100000:0.0:1789448172.532041:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:6668:x1876372317280128:12345-0@lo:101: Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.532047:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789448172.532259:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280128:0@lo:101: 00010000:00010000:2.0:1789448172.532272:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.532282:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.532525:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280256:0@lo:501: 00000100:00100000:2.0:1789448172.532554:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.532585:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448172.532646:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280256 00000100:00100000:1.0:1789448172.532652:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280256 00000100:00100000:1.0:1789448172.532687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448172.532695:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:6668:x1876372317280256:12345-0@lo:501: 00000100:00100000:1.0:1789448172.532959:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:6668:x1876372317280256:12345-0@lo:501: Request processed in 264us (403us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789448172.532966:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789448172.533092:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280256:0@lo:501: 10000000:01000000:2.0:1789448172.533107:0:6668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789448172.533142:0:6668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789448172.533150:0:6668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.533160:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.533169:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.533195:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448172.533254:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97d9c336e800 10000000:01000000:2.0:1789448172.533260:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789448172.533265:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97d9eaf63380 10000000:01000000:2.0:1789448172.533268:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789448172.533271:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97d9eaf63380 from 1 10000000:01000000:2.0:1789448172.533274:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789448172.533307:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533489:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448172.533497:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533505:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a0400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448172.533509:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533518:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448172.533526:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.533533:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789448172.533555:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533560:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448172.533594:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533601:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0400/0xe29566c2465f9573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f957a expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533622:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448172.533624:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448172.533633:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448172.533690:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317280512:0@lo:103: 00000100:00100000:3.0:1789448172.533736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.533854:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280512 00000100:00100000:1.0:1789448172.533860:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280512 00000100:00100000:1.0:1789448172.533906:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448172.533913:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:3307:x1876372317280512:12345-0@lo:103: 00010000:00010000:1.0:1789448172.533924:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448172.533937:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f957a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f9573 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.533953:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448172.534067:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:3307:x1876372317280512:12345-0@lo:103: Request processed in 153us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.534074:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789448172.534114:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.534123:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448172.534137:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280384:0@lo:101: 00000100:00100000:2.0:1789448172.534164:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.534187:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448172.534832:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280384 00000100:00100000:1.0:1789448172.534840:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280384 00000100:00100000:1.0:1789448172.534883:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448172.534891:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:6668:x1876372317280384:12345-0@lo:101: 00010000:00010000:1.0:1789448172.534905:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448172.534921:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58c00/0xe29566c2465f9588 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9581 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.534944:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58c00/0xe29566c2465f9588 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9581 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.534957:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58c00/0xe29566c2465f9588 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9581 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.534965:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58c00, rc 0) 00000100:00100000:1.0:1789448172.535010:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:6668:x1876372317280384:12345-0@lo:101: Request processed in 120us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.535027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448172.535076:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280384:0@lo:101: 00010000:00010000:1.0:1789448172.535089:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.535097:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.535118:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789448172.535128:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.535135:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.535143:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789448172.535149:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789448172.535155:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789448172.535158:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789448172.535177:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.535184:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.535192:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.535205:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280640:0@lo:101: 00000100:00100000:1.0:1789448172.535261:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.535281:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.535480:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280640 00000100:00100000:0.0:1789448172.535485:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280640 00000100:00100000:0.0:1789448172.535514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789448172.535522:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+10:6668:x1876372317280640:12345-0@lo:101: 00010000:00010000:0.0:1789448172.535529:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448172.535542:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f958f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.535556:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f958f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.535565:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f958f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.535572:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c0031a00, rc 0) 00000100:00100000:0.0:1789448172.535605:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317280640:12345-0@lo:101: Request processed in 84us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.535611:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789448172.535741:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280640:0@lo:101: 00010000:00010000:1.0:1789448172.535751:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.535758:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.535865:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280768:0@lo:501: 00000100:00100000:1.0:1789448172.535893:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.535915:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.537586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280768 00000100:00100000:0.0:1789448172.537605:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280768 00000100:00100000:0.0:1789448172.537674:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789448172.537686:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317280768:12345-0@lo:501: 00000100:00100000:0.0:1789448172.538066:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317280768:12345-0@lo:501: Request processed in 381us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.538073:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448172.539500:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280768:0@lo:501: 00000100:00100000:1.0:1789448172.539575:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280896:0@lo:503: 00000100:00100000:1.0:1789448172.539656:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.539706:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.539776:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317280896 00000100:00100000:2.0:1789448172.539793:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317280896 00000100:00100000:2.0:1789448172.539836:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789448172.539846:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317280896:12345-0@lo:503: 00000100:00100000:2.0:1789448172.540057:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317280896:12345-0@lo:503: Request processed in 213us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.540065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789448172.541529:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317280896:0@lo:503: 00000040:00080000:1.0:1789448172.541914:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448172.542003:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281024:0@lo:502: 00000100:00100000:1.0:1789448172.542069:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.542116:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.542250:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281024 00000100:00100000:2.0:1789448172.542258:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281024 00000100:00100000:2.0:1789448172.542482:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789448172.542494:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317281024:12345-0@lo:502: 00000100:00100000:2.0:1789448172.542714:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317281024:12345-0@lo:502: Request processed in 221us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.542722:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448172.542841:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281024:0@lo:502: 00000040:00080000:0.0:1789448172.543162:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789448172.543254:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789448172.543304:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789448172.543493:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789448172.543534:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789448172.543569:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789448172.543605:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281152:0@lo:502: 00000100:00100000:0.0:1789448172.543658:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448172.543692:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c7763180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448172.543777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281152 00000100:00100000:1.0:1789448172.543784:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281152 00000100:00100000:1.0:1789448172.543829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789448172.543838:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317281152:12345-0@lo:502: 00000100:00100000:1.0:1789448172.544004:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317281152:12345-0@lo:502: Request processed in 166us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.544018:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448172.544255:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281152:0@lo:502: 00000100:00100000:3.0:1789448172.544538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317280512:0@lo:103: 00000040:00080000:0.0:1789448172.544757:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789448172.544770:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789448172.546664:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789448172.546679:0:6687:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789448172.546687:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448172.546690:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789448172.546713:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448172.546733:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97d9f4944d40) 00000020:00000080:3.0:1789448172.546762:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789448172.546769:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448172.546843:0:6687:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9c336e800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789448172.546852:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789448172.546859:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe29566c2465f95a4 00010000:00010000:2.0:1789448172.558068:0:6687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789448172.565810:0:6687:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789448172.567926:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789448172.571444:0:6687:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789448172.579982:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789448172.581031:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789448172.582937:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789448172.582951:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448172.582958:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448172.582960:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789448172.582963:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448172.582968:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448172.582969:0:6687:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789448172.582972:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789448172.582974:0:6687:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789448172.583042:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448172.583045:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448172.583047:0:6687:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789448172.583050:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789448172.583587:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789448172.583616:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789448172.584562:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.584577:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.584586:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c336e800 from 1 10000000:01000000:1.0:1789448172.584589:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789448172.584638:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.584647:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.584660:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.584688:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281280:0@lo:101: 00000100:00100000:1.0:1789448172.584780:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.584844:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.584925:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281280 00000100:00100000:2.0:1789448172.584935:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281280 00000100:00100000:2.0:1789448172.584994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789448172.585004:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:6668:x1876372317281280:12345-0@lo:101: 00010000:00010000:2.0:1789448172.585020:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448172.585035:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f95ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.585062:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f95ab expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.585082:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95ab expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448172.585093:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0400, rc 0) 00000100:00100000:2.0:1789448172.585137:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281280:12345-0@lo:101: Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.585143:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448172.586575:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281280:0@lo:101: 00010000:00010000:1.0:1789448172.586598:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.586609:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.586745:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281408:0@lo:501: 00000100:00100000:1.0:1789448172.586788:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.591860:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.592501:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281408 00000100:00100000:2.0:1789448172.592517:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281408 00000100:00100000:2.0:1789448172.592584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789448172.592597:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281408:12345-0@lo:501: 00000100:00100000:2.0:1789448172.592994:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281408:12345-0@lo:501: Request processed in 400us (6204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.593003:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789448172.593748:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281408:0@lo:501: 00000100:00100000:1.0:1789448172.593822:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281536:0@lo:503: 00000100:00100000:1.0:1789448172.593881:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.593921:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.593980:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281536 00000100:00100000:2.0:1789448172.593987:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281536 00000100:00100000:2.0:1789448172.594017:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448172.594024:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281536:12345-0@lo:503: 00000100:00100000:2.0:1789448172.594325:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281536:12345-0@lo:503: Request processed in 291us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.594332:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789448172.594609:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281536:0@lo:503: 00000040:00080000:1.0:1789448172.594967:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448172.595047:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281664:0@lo:502: 00000100:00100000:1.0:1789448172.595092:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.595130:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.595213:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281664 00000100:00100000:2.0:1789448172.595257:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281664 00000100:00100000:2.0:1789448172.595288:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789448172.595307:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281664:12345-0@lo:502: 00000100:00100000:2.0:1789448172.595569:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281664:12345-0@lo:502: Request processed in 262us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.595583:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789448172.595698:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281664:0@lo:502: 00000040:00080000:1.0:1789448172.596694:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789448172.596762:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789448172.596804:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281792:0@lo:502: 00000100:00100000:1.0:1789448172.596871:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.596911:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.598698:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281792 00000100:00100000:2.0:1789448172.598719:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281792 00000100:00100000:2.0:1789448172.598794:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448172.598807:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281792:12345-0@lo:502: 00000100:00100000:2.0:1789448172.599150:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281792:12345-0@lo:502: Request processed in 344us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.599159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789448172.599934:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281792:0@lo:502: 00000040:00080000:0.0:1789448172.600155:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789448172.600174:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789448172.602163:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448172.602181:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448172.602183:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789448172.602192:0:6691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9c336e800 00000020:00000080:0.0:1789448172.602194:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448172.602449:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448172.602467:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448172.602469:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789448172.602472:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789448172.602616:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789448172.602640:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448172.602665:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.602680:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448172.602744:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789448172.602748:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97d9c336e800 10000000:01000000:1.0:1789448172.602752:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97d9c336e800 10000000:01000000:1.0:1789448172.602757:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789448172.602764:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c336e800 from 1 10000000:01000000:1.0:1789448172.602767:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789448172.602828:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.602836:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.602849:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.602876:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281920:0@lo:101: 00000100:00100000:1.0:1789448172.602968:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.603077:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.608777:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317281920 00000100:00100000:2.0:1789448172.608800:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317281920 00000100:00100000:0.0:1789448172.612721:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448172.612740:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317281920:12345-0@lo:101: 00010000:00010000:0.0:1789448172.612764:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448172.612789:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f95b9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.613104:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.613118:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.613127:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c0030a00, rc 0) 00000100:00100000:0.0:1789448172.613258:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317281920:12345-0@lo:101: Request processed in 522us (10289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.613287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789448172.614100:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317281920:0@lo:101: 00010000:00010000:1.0:1789448172.614131:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.614145:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.614350:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282048:0@lo:501: 00000100:00100000:1.0:1789448172.614415:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.614474:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.614779:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282048 00000100:00100000:2.0:1789448172.614792:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282048 00000100:00100000:2.0:1789448172.614849:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448172.614860:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282048:12345-0@lo:501: 00000100:00100000:2.0:1789448172.615251:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282048:12345-0@lo:501: Request processed in 357us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.615260:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789448172.615507:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282048:0@lo:501: 00000100:00100000:1.0:1789448172.615552:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282176:0@lo:503: 00000100:00100000:1.0:1789448172.615613:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.615658:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:0.0:1789448172.615880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282176 00000100:00100000:0.0:1789448172.615888:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282176 00000100:00100000:0.0:1789448172.615939:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789448172.615949:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282176:12345-0@lo:503: 00000100:00100000:0.0:1789448172.616158:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282176:12345-0@lo:503: Request processed in 210us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.616166:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789448172.618871:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282176:0@lo:503: 00000040:00080000:1.0:1789448172.619263:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448172.619354:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282304:0@lo:502: 00000100:00100000:1.0:1789448172.619427:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.619466:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.619547:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282304 00000100:00100000:2.0:1789448172.619561:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282304 00000100:00100000:2.0:1789448172.619644:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789448172.619656:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282304:12345-0@lo:502: 00000100:00100000:3.0:1789448172.619974:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282304:12345-0@lo:502: Request processed in 316us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448172.619986:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789448172.620298:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282304:0@lo:502: 00000040:00080000:1.0:1789448172.620656:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789448172.620720:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789448172.620755:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789448172.620803:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789448172.620850:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789448172.620891:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789448172.620922:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789448172.620953:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789448172.621000:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789448172.621034:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789448172.621065:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789448172.621109:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789448172.621141:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789448172.621171:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789448172.621254:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789448172.621304:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789448172.621342:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789448172.621389:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789448172.621437:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789448172.621471:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789448172.621535:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789448172.621573:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789448172.621606:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789448172.621651:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789448172.621686:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789448172.621721:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789448172.621771:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789448172.621810:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789448172.621857:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282432:0@lo:502: 00000100:00100000:1.0:1789448172.621927:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.621964:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448172.622460:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282432 00000100:00100000:2.0:1789448172.622469:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282432 00000100:00100000:2.0:1789448172.622516:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789448172.622527:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282432:12345-0@lo:502: 00000100:00100000:2.0:1789448172.623493:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282432:12345-0@lo:502: Request processed in 962us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.623516:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789448172.623654:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282432:0@lo:502: 00000040:00080000:1.0:1789448172.623770:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789448172.623787:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789448172.626199:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789448172.626435:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97d8c196cd40) 00000020:00000080:2.0:1789448172.626463:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789448172.626556:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9c336e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789448172.626561:0:6692:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9c336e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789448172.626565:0:6692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c336e800 3 00010000:00080000:2.0:1789448172.626668:0:6692:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9c86c8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789448172.634957:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789448172.635169:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789448172.635243:0:6692:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789448172.635258:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe29566c2465f95ce 00000100:00080000:3.0:1789448172.635269:0:6692:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448172.635281:0:6692:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97d9c86c8800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448172.635332:0:6692:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9eada1c00 x1876372317282560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448172.635356:0:6692:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789448172.635957:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317282560:0@lo:38: 00000100:00100000:0.0:1789448172.636028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.637367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282560 00000100:00100000:2.0:1789448172.637386:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282560 00000100:00100000:2.0:1789448172.637445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448172.637456:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876372317282560:12345-0@lo:38: 00010000:00080000:2.0:1789448172.637494:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1789448172.637538:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe29566c2465f95d5 00000004:00100000:2.0:1789448172.637557:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789448172.637769:0:5835:0:(import.c:65:import_set_state_nolock()) ffff97d9c86cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448172.637886:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876372317282560:12345-0@lo:38: Request processed in 430us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.637893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789448172.637959:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9eada1c00 x1876372317282560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448172.637972:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448172.637983:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789448172.637991:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789448172.637997:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789448172.638000:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9c86c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789448172.638007:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317282560:0@lo:38: 00000100:00100000:1.0:1789448172.638358:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448172.638374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317282688:0@lo:400: 00000100:00100000:1.0:1789448172.638419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448172.639460:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282688 00000100:00100000:2.0:1789448172.639470:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282688 00000100:00100000:2.0:1789448172.639514:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448172.639523:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317282688:12345-0@lo:400: 00000040:00080000:3.0:1789448172.641458:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1789448172.641744:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317282688:12345-0@lo:400: Request processed in 2213us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448172.641758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789448172.641912:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9ce827b80 x1876372317282688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448172.641930:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317282688:0@lo:400: 00000020:01000000:0.0:1789448172.645341:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789448172.645385:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448172.645411:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.645428:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789448172.645507:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789448172.645510:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448172.645512:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448172.645513:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448172.645515:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448172.645517:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448172.645519:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448172.645528:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448172.645530:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448172.645532:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448172.645533:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448172.645538:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789448172.645540:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789448172.645541:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448172.645542:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448172.645544:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448172.645545:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448172.645546:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448172.645547:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448172.645548:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448172.645549:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448172.645550:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448172.645551:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448172.645989:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789448172.646013:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282816:0@lo:253: 00000100:00100000:0.0:1789448172.646105:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448172.646209:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c77639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448172.646445:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282816 00000100:00100000:3.0:1789448172.646454:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282816 00000100:00100000:3.0:1789448172.646507:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789448172.646517:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6668:x1876372317282816:12345-0@lo:253: 20000000:01000000:3.0:1789448172.646545:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789448172.646559:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789448172.685790:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789448172.685845:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789448172.685911:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789448172.685917:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789448172.686186:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.686210:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f952d expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.686262:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.686332:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448172.686363:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 13 pid: 5828 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.686379:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317282944:0@lo:104: 00000100:00100000:1.0:1789448172.686448:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448172.686510:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448172.686556:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317282944 00000100:00100000:3.0:1789448172.686638:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317282944 00000100:00100000:3.0:1789448172.686716:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448172.686729:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317282944:12345-0@lo:104: 00010000:00010000:3.0:1789448172.686761:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448172.686873:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448172.686881:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317282944:12345-0@lo:104: Request processed in 155us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448172.686891:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448172.686917:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317282944:0@lo:104: 00010000:00010000:1.0:1789448172.687199:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687310:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448172.687328:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687335:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0030600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448172.687340:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687349:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448172.687356:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448172.687362:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448172.687418:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687425:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448172.687449:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687456:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f952d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9534 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448172.687474:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448172.687475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448172.687625:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317283072:0@lo:103: 00000100:00100000:1.0:1789448172.687670:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448172.687758:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283072 00000100:00100000:0.0:1789448172.687766:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283072 00010000:00010000:0.0:1789448172.687792:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 14 pid: 5828 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448172.687825:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448172.687834:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3305:x1876372317283072:12345-0@lo:103: 00010000:00010000:0.0:1789448172.687846:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448172.687850:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 14 pid: 5828 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687860:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 14 pid: 5828 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687871:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59c00/0xe29566c2465f9534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f952d expref: 14 pid: 5828 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687884:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687900:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789448172.687913:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001997777s 00010000:00010000:0.0:1789448172.687918:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.687925:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688072:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688081:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688087:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448172.688091:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688098:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688117:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448172.688127:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448172.688166:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3305:x1876372317283072:12345-0@lo:103: Request processed in 334us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448172.688173:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789448172.688287:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448172.688319:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448172.688328:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59600/0xe29566c2465f95dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448172.688369:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317283072:0@lo:103: 00010000:00010000:1.0:1789448172.698167:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448172.702376:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:6668:x1876372317282816:12345-0@lo:253: Request processed in 55842us (56253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448172.702390:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789448172.702503:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6668:1876372317282816:0@lo:253: 10000000:01000000:0.0:1789448172.702530:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789448172.702534:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448172.702536:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448172.702538:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448172.702539:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448172.702541:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448172.702542:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448172.702543:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448172.702545:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789448172.702546:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789448172.702548:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448172.702549:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789448172.702578:0:6668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789448172.707905:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448172.708074:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789448172.708339:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448172.708522:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789448172.708742:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448172.708981:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789448172.710546:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789448172.966734:0:6668:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789448172.966741:0:6668:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789448172.966780:0:6668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789448172.966846:0:6668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789448172.966862:0:6668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789448172.966889:0:6668:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789448173.721584:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789448174.170256:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789448174.170266:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c6cee800 from 21 10000000:01000000:3.0:1789448174.170272:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789448174.173031:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448174.173051:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448174.173063:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448174.173089:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283200:0@lo:101: 00000100:00100000:2.0:1789448174.173155:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448174.173206:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c317e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448174.173579:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283200 00000100:00100000:1.0:1789448174.173586:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283200 00000100:00100000:1.0:1789448174.173660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789448174.173669:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317283200:12345-0@lo:101: 00010000:00010000:1.0:1789448174.173683:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448174.173695:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f95e3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448174.173718:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448174.173729:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448174.173739:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58400, rc 0) 00000100:00100000:1.0:1789448174.173787:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283200:12345-0@lo:101: Request processed in 118us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448174.173793:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789448174.174534:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283200:0@lo:101: 00010000:00010000:1.0:1789448174.174551:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448174.174561:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448174.174629:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283328:0@lo:501: 00000100:00100000:1.0:1789448174.174662:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448174.174694:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.175447:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283328 00000100:00100000:2.0:1789448174.175456:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283328 00000100:00100000:2.0:1789448174.175490:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789448174.175498:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283328:12345-0@lo:501: 00000100:00100000:2.0:1789448174.176977:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283328:12345-0@lo:501: Request processed in 1471us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448174.176990:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789448174.178769:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283328:0@lo:501: 00000100:00100000:2.0:1789448174.179682:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283456:0@lo:503: 00000100:00100000:2.0:1789448174.179762:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448174.179799:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c317e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.179818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283456 00000100:00100000:2.0:1789448174.179825:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283456 00000100:00100000:2.0:1789448174.179878:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789448174.179886:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283456:12345-0@lo:503: 00000100:00100000:2.0:1789448174.180269:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283456:12345-0@lo:503: Request processed in 382us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448174.180296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789448174.180377:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283456:0@lo:503: 00000100:00100000:3.0:1789448174.192262:0:6757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6757:1876372317283584:0@lo:502: 00000100:00100000:3.0:1789448174.192370:0:6757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.192410:0:6757:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.192597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283584 00000100:00100000:2.0:1789448174.192605:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283584 00000100:00100000:2.0:1789448174.192649:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789448174.192658:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6757:x1876372317283584:12345-0@lo:502: 00000100:00100000:2.0:1789448174.193103:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6757:x1876372317283584:12345-0@lo:502: Request processed in 445us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448174.193110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789448174.193982:0:6757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6757:1876372317283584:0@lo:502: 00000100:00100000:2.0:1789448174.198705:0:6757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6757:1876372317283712:0@lo:502: 00000100:00100000:2.0:1789448174.198793:0:6757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.198930:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283712 00000100:00100000:0.0:1789448174.198937:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283712 00000100:00100000:0.0:1789448174.198985:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789448174.198994:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6757:x1876372317283712:12345-0@lo:502: 00000100:00100000:0.0:1789448174.199233:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:6757:x1876372317283712:12345-0@lo:502: Request processed in 222us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.199242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789448174.201958:0:6757:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c317e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.202001:0:6757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6757:1876372317283712:0@lo:502: 00000040:00080000:2.0:1789448174.202045:0:6757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789448174.211579:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789448174.211626:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789448174.211637:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.211650:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448174.215349:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789448174.215357:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9c6cee800 from 4 10000000:01000000:3.0:1789448174.215362:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789448174.215408:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.215421:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.215551:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448174.215580:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283840:0@lo:101: 00000100:00100000:3.0:1789448174.215645:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.215701:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.215762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283840 00000100:00100000:0.0:1789448174.215771:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283840 00000100:00100000:0.0:1789448174.215823:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789448174.215833:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317283840:12345-0@lo:101: 00010000:00010000:0.0:1789448174.215845:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448174.215858:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f95f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.215880:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.215906:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.215915:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c0030200, rc 0) 00000100:00100000:0.0:1789448174.215960:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317283840:12345-0@lo:101: Request processed in 128us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.215966:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789448174.216012:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283840:0@lo:101: 00010000:00010000:0.0:1789448174.216025:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216035:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448174.216078:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283968:0@lo:256: 00000100:00100000:0.0:1789448174.216107:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.216128:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317283968 00000100:00100000:0.0:1789448174.216132:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317283968 00000100:00100000:0.0:1789448174.216152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448174.216159:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317283968:12345-0@lo:256: 20000000:01000000:0.0:1789448174.216173:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789448174.216189:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789448174.216192:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789448174.216292:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317283968:12345-0@lo:256: Request processed in 133us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.216308:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448174.216336:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.216347:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317283968:0@lo:256: 10000000:01000000:0.0:1789448174.216382:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448174.216388:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216396:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448174.216404:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789448174.216406:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789448174.216409:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789448174.216423:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216441:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216449:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448174.216461:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284096:0@lo:101: 00000100:00100000:0.0:1789448174.216483:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.216502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284096 00000100:00100000:0.0:1789448174.216506:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284096 00000100:00100000:0.0:1789448174.216526:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448174.216532:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317284096:12345-0@lo:101: 00010000:00010000:0.0:1789448174.216538:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448174.216546:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f95ff expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216566:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f95ff expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216574:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95ff expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216581:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c0031e00, rc 0) 00000100:00100000:0.0:1789448174.216604:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317284096:12345-0@lo:101: Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.216610:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448174.216631:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.216640:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284096:0@lo:101: 00010000:00010000:0.0:1789448174.216649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448174.216656:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448174.216695:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284224:0@lo:501: 00000100:00100000:0.0:1789448174.216716:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.216733:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284224 00000100:00100000:0.0:1789448174.216737:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284224 00000100:00100000:0.0:1789448174.216755:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448174.216760:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317284224:12345-0@lo:501: 00000100:00100000:0.0:1789448174.216989:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317284224:12345-0@lo:501: Request processed in 227us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.216996:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448174.217024:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.217035:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284224:0@lo:501: 00000100:00100000:0.0:1789448174.217056:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284352:0@lo:503: 00000100:00100000:0.0:1789448174.217091:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.217107:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284352 00000100:00100000:0.0:1789448174.217111:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284352 00000100:00100000:0.0:1789448174.217127:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789448174.217132:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317284352:12345-0@lo:503: 00000100:00100000:0.0:1789448174.217427:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317284352:12345-0@lo:503: Request processed in 294us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.217434:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789448174.217464:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.217474:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317284352:0@lo:503: 00000100:00100000:3.0:1789448174.218014:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6759:1876372317284480:0@lo:502: 00000100:00100000:3.0:1789448174.218051:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.218083:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.218194:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284480 00000100:00100000:0.0:1789448174.218198:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284480 00000100:00100000:0.0:1789448174.218239:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789448174.218246:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:6759:x1876372317284480:12345-0@lo:502: 00000100:00100000:0.0:1789448174.218732:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:6759:x1876372317284480:12345-0@lo:502: Request processed in 485us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.218740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789448174.223990:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6759:1876372317284480:0@lo:502: 00000020:01000000:0.0:1789448174.226666:0:6759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789448174.226678:0:6759:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789448174.226686:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448174.226689:0:6759:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789448174.226694:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789448174.226700:0:6759:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:0.0:1789448174.226727:0:6759:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789448174.226735:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448174.226751:0:6759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97d9ceaa99c0) 00000020:00000080:0.0:1789448174.226774:0:6759:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789448174.226779:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789448174.226874:0:6759:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789448174.226880:0:6759:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789448174.226888:0:6759:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f9614 00010000:00080000:0.0:1789448174.226920:0:6759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d8c1955000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1789448174.227146:0:6759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789448174.264520:0:6759:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789448174.264543:0:6759:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789448174.265055:0:6759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448174.265254:0:6759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448174.265321:0:6759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789448174.265380:0:6759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789448174.268653:0:6762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448174.268660:0:6762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789448174.271905:0:6759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448174.271922:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789448174.271968:0:6759:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789448174.271999:0:6759:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465f961b 00000100:00080000:3.0:1789448174.272010:0:6759:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448174.272022:0:6759:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97d8c1955000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448174.272059:0:6759:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9eada0700 x1876372317284608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448174.272084:0:6759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789448174.272141:0:6759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448174.272145:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448174.272147:0:6759:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789448174.272150:0:6759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448174.272153:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448174.272155:0:6759:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448174.272158:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448174.272160:0:6759:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789448174.272187:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6759:1876372317284736:0@lo:502: 00000100:00100000:3.0:1789448174.272403:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.272445:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448174.272504:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284736 00000100:00100000:3.0:1789448174.272511:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284736 00000100:00100000:3.0:1789448174.272547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789448174.272557:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:6759:x1876372317284736:12345-0@lo:502: 00000100:00100000:3.0:1789448174.272784:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:6759:x1876372317284736:12345-0@lo:502: Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448174.272792:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789448174.274033:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317284608:0@lo:8: 00000100:00100000:2.0:1789448174.274099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.274212:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317284864:0@lo:400: 00000100:00100000:3.0:1789448174.274265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.274400:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284608 00000100:00100000:0.0:1789448174.274407:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284608 00000100:00100000:0.0:1789448174.274439:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448174.274446:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876372317284608:12345-0@lo:8: 00010000:00080000:0.0:1789448174.274472:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1789448174.274504:0:6671:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465f9622 00002000:00100000:0.0:1789448174.274541:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97d8c1954800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789448174.274546:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789448174.274550:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789448174.274666:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789448174.274804:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789448174.274992:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448174.275002:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317284992:0@lo:400: 00000100:00100000:3.0:1789448174.275046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.275095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284864 00000100:00100000:3.0:1789448174.275100:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284864 00000100:00100000:3.0:1789448174.275128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317284992 00000100:00100000:3.0:1789448174.275130:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317284992 00000100:00100000:3.0:1789448174.275153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448174.275159:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317284864:12345-0@lo:400: 00000100:00100000:3.0:1789448174.275205:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317284864:12345-0@lo:400: Request processed in 45us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448174.275211:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448174.275246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448174.275252:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317284992:12345-0@lo:400: 00000100:00100000:3.0:1789448174.275296:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317284992:12345-0@lo:400: Request processed in 43us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448174.275419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789448174.275459:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada3b80 x1876372317284992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448174.275473:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317284992:0@lo:400: 00010000:00080000:3.0:1789448174.275484:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada0380 x1876372317284864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448174.275492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317284864:0@lo:400: 00000100:00100000:3.0:1789448174.275519:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:6759:1876372317284736:0@lo:502: 00000020:01000000:3.0:1789448174.275552:0:6759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448174.275557:0:6759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448174.275560:0:6759:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789448174.275564:0:6759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789448174.275684:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789448174.275704:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789448174.275713:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.275723:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448174.275733:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789448174.275736:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97d9eaf63380 from 1 10000000:01000000:3.0:1789448174.275738:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789448174.275766:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.275773:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.275781:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448174.275795:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317285120:0@lo:101: 00000100:00100000:3.0:1789448174.275825:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789448174.275936:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97d8c1957000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448174.275999:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876372317284608:12345-0@lo:8: Request processed in 1553us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.276006:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789448174.276027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789448174.276421:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada0700 x1876372317284608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448174.276432:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448174.276440:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789448174.276447:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789448174.276453:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789448174.276455:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d8c1955000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789448174.276465:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789448174.276470:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317284608:0@lo:8: 00000100:00100000:3.0:1789448174.276547:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448174.276565:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285120 00000100:00100000:3.0:1789448174.276571:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285120 00000100:00100000:3.0:1789448174.276638:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789448174.276647:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317285120:12345-0@lo:101: 00010000:00010000:3.0:1789448174.276656:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448174.276669:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9629 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.276703:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9629 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.276714:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9629 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.276724:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523000, rc 0) 00000100:00100000:3.0:1789448174.276756:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317285120:12345-0@lo:101: Request processed in 111us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448174.276762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1789448174.277476:0:6762:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789448174.277606:0:6762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 195980387727ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789448174.278158:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317285120:0@lo:101: 00010000:00010000:3.0:1789448174.278179:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.278190:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448174.278293:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317285248:0@lo:501: 00000100:00100000:3.0:1789448174.278433:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.278471:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789448174.278631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285248 00000100:00100000:1.0:1789448174.278637:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285248 00000100:00100000:1.0:1789448174.278678:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448174.278698:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317285248:12345-0@lo:501: 00000100:00100000:1.0:1789448174.278986:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317285248:12345-0@lo:501: Request processed in 288us (551us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789448174.278993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789448174.279065:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317285248:0@lo:501: 10000000:01000000:3.0:1789448174.279088:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789448174.279095:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448174.279104:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448174.344985:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789448174.362122:0:6763:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789448174.362153:0:6763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285504:0@lo:7: 00000100:00100000:0.0:1789448174.362264:0:6763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448174.362421:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317285376:0@lo:13: 00000100:00100000:2.0:1789448174.362452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.362555:0:6763:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448174.362584:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285376 00000100:00100000:0.0:1789448174.362592:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285376 00000100:00100000:0.0:1789448174.362644:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448174.362653:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317285376:12345-0@lo:13: 00002000:00000024:0.0:1789448174.362686:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789448174.362733:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317285376:12345-0@lo:13: Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448174.362741:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789448174.362761:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789448174.362792:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9fb0b0380 x1876372317285376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448174.362811:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317285376:0@lo:13: 00000100:00100000:2.0:1789448174.362935:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285504 00000100:00100000:2.0:1789448174.362940:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285504 00000100:00100000:2.0:1789448174.362966:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448174.362973:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876372317285504:12345-0@lo:7: 00002000:00080000:2.0:1789448174.368599:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789448174.368606:0:6673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789448174.368710:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876372317285504:12345-0@lo:7: Request processed in 5734us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448174.368718:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448174.368791:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9fb0b3480 x1876372317285504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789448190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448174.368806:0:6763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285504:0@lo:7: 00000004:00080000:0.0:1789448174.368817:0:6763:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789448174.368904:0:6763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285632:0@lo:5: 00000100:00100000:0.0:1789448174.368935:0:6763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448174.368990:0:6763:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.369022:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285632 00000100:00100000:2.0:1789448174.369028:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285632 00000100:00100000:2.0:1789448174.369082:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448174.369088:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6763:x1876372317285632:12345-0@lo:5: 00002000:00080000:2.0:1789448174.369107:0:6671:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789448174.369110:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789448174.369342:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6763:x1876372317285632:12345-0@lo:5: Request processed in 252us (404us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789448174.369349:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789448174.369523:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9fb0b3480 x1876372317285632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448174.369532:0:6763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285632:0@lo:5: 00000004:00080000:1.0:1789448174.369538:0:6763:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789448174.369561:0:6763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285760:0@lo:700: 00000100:00100000:1.0:1789448174.369603:0:6763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448174.369628:0:6763:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448174.369685:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285760 00000100:00100000:3.0:1789448174.369691:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285760 00000100:00100000:3.0:1789448174.369720:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448174.369725:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6763:x1876372317285760:12345-0@lo:700: 00000100:00100000:3.0:1789448174.369752:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1876372317285888:0@lo:700: 00000100:00100000:3.0:1789448174.369780:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448174.369795:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789448174.369852:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317285888 00000100:00100000:1.0:1789448174.369855:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317285888 00000100:00100000:1.0:1789448174.369880:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448174.369885:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1876372317285888:12345-0@lo:700: 40000000:02000000:1.0:1789448174.385696:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789448174.388526:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1876372317285888:12345-0@lo:700: Request processed in 18633us (18737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448174.388538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789448174.388805:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada1500 x1876372317285888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789448190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448174.388818:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1876372317285888:0@lo:700: 40000000:02000000:3.0:1789448174.388837:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1789448174.435778:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789448174.435801:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789448174.436037:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6763:x1876372317285760:12345-0@lo:700: Request processed in 66305us (66428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448174.436051:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789448174.436132:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8d180 x1876372317285760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789448190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448174.436146:0:6763:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789448174.436180:0:6763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317285760:0@lo:700: 00000004:02000040:1.0:1789448174.470715:0:6763:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789448174.476995:0:6763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317286016:0@lo:5: 00000100:00100000:1.0:1789448174.477065:0:6763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448174.477150:0:6763:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448174.478043:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286016 00000100:00100000:2.0:1789448174.478052:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286016 00000100:00100000:2.0:1789448174.478106:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448174.478117:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6763:x1876372317286016:12345-0@lo:5: 00002000:00080000:1.0:1789448174.484601:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789448174.484620:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789448174.488582:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876372317286016:12345-0@lo:5: Request processed in 10461us (11510us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789448174.488600:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789448174.488789:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8d180 x1876372317286016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448174.488808:0:6763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876372317286016:0@lo:5: 00000004:00080000:2.0:1789448174.488821:0:6763:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789448174.750084:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448175.769414:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448176.795963:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448177.820550:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448178.844442:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448179.481511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317286272:0@lo:400: 00000100:00100000:3.0:1789448179.481605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448179.481676:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448179.481683:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317286400:0@lo:400: 00000100:00100000:3.0:1789448179.481705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448179.481742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317286144:0@lo:400: 00000100:00100000:3.0:1789448179.481745:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286272 00000100:00100000:3.0:1789448179.481752:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286272 00000100:00100000:0.0:1789448179.481781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448179.481802:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286400 00000100:00100000:3.0:1789448179.481805:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286400 00000100:00100000:0.0:1789448179.481807:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448179.481812:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317286528:0@lo:400: 00000100:00100000:3.0:1789448179.481833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448179.481836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448179.481842:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317286272:12345-0@lo:400: 00000100:00100000:0.0:1789448179.481871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286144 00000100:00100000:0.0:1789448179.481874:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286144 00000100:00100000:0.0:1789448179.481904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789448179.481911:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3305:x1876372317286144:12345-0@lo:400: 00000100:00100000:0.0:1789448179.481957:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3305:x1876372317286144:12345-0@lo:400: Request processed in 46us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448179.481965:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789448179.481998:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448179.482034:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317286144:0@lo:400: 00000100:00100000:2.0:1789448179.482348:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286528 00000100:00100000:2.0:1789448179.482352:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286528 00000100:00100000:2.0:1789448179.482388:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448179.482396:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317286528:12345-0@lo:400: 00000100:00100000:2.0:1789448179.482435:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317286528:12345-0@lo:400: Request processed in 41us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448179.482441:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448179.482719:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448179.482730:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317286656:0@lo:13: 00000100:00100000:2.0:1789448179.482765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448179.482804:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286656 00000100:00100000:2.0:1789448179.482808:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286656 00000100:00100000:3.0:1789448179.482824:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317286272:12345-0@lo:400: Request processed in 982us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448179.482832:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448179.482832:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448179.482838:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317286656:12345-0@lo:13: 00000100:00100000:3.0:1789448179.482847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448179.482853:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317286400:12345-0@lo:400: 00002000:00000024:2.0:1789448179.482864:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448179.482896:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317286656:12345-0@lo:13: Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448179.482913:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789448179.482933:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789448179.482955:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9ce827100 x1876372317286656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448179.482961:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317286400:12345-0@lo:400: Request processed in 25us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448179.482968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448179.482974:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317286656:0@lo:13: 00010000:00080000:3.0:1789448179.483007:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada2d80 x1876372317286400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448179.483018:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317286400:0@lo:400: 00010000:00080000:3.0:1789448179.483028:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada3b80 x1876372317286272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448179.483036:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317286272:0@lo:400: 00010000:00080000:0.0:1789448179.485416:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada1f80 x1876372317286528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448179.485442:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317286528:0@lo:400: 00000001:00080000:1.0:1789448179.605587:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789448179.865925:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789448179.871180:0:7041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789448180.890263:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448181.915341:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448182.939171:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448183.967602:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448184.603501:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317287168:0@lo:400: 00000100:00100000:3.0:1789448184.603562:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317286784:0@lo:13: 00000100:00100000:3.0:1789448184.603685:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448184.603730:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317287040:0@lo:400: 00000100:00100000:3.0:1789448184.603746:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317287296:0@lo:400: 00000100:00100000:3.0:1789448184.603770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448184.603784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448184.603802:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448184.603808:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317286912:0@lo:400: 00000100:00100000:3.0:1789448184.603841:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448184.603918:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286784 00000100:00100000:3.0:1789448184.603929:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286784 00000100:00100000:3.0:1789448184.604015:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448184.604026:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317286784:12345-0@lo:13: 00000100:00100000:2.0:1789448184.604041:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317286912 00000100:00100000:2.0:1789448184.604045:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317286912 00002000:00000024:3.0:1789448184.604072:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448184.604075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789448184.604082:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3306:x1876372317286912:12345-0@lo:400: 00000100:00100000:2.0:1789448184.604178:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3306:x1876372317286912:12345-0@lo:400: Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448184.604194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448184.606398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448184.606620:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287296 00000100:00100000:1.0:1789448184.606631:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287296 00000100:00100000:1.0:1789448184.606694:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448184.606706:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317287296:12345-0@lo:400: 00000100:00100000:3.0:1789448184.608534:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317286784:12345-0@lo:13: Request processed in 4498us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448184.608551:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448184.608867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287040 00000100:00100000:3.0:1789448184.608879:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287040 00000100:00100000:3.0:1789448184.608929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287168 00000100:00100000:3.0:1789448184.608933:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287168 00000100:00100000:3.0:1789448184.608957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448184.608967:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317287040:12345-0@lo:400: 00000100:00100000:3.0:1789448184.609056:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317287040:12345-0@lo:400: Request processed in 91us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448184.609063:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448184.609076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448184.609083:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317287168:12345-0@lo:400: 00000100:00100000:3.0:1789448184.609120:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317287168:12345-0@lo:400: Request processed in 39us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448184.609126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789448184.609173:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448184.609178:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789448184.609734:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8c000 x1876372317287040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448184.609755:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317287040:0@lo:400: 00000100:00100000:3.0:1789448184.609811:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317286912:0@lo:400: 00010000:00080000:3.0:1789448184.609829:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8e680 x1876372317286784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448184.609854:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789448184.609875:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317286784:0@lo:13: 00000100:00100000:1.0:1789448184.614336:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317287296:12345-0@lo:400: Request processed in 7621us (10552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448184.614355:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789448184.614461:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8df80 x1876372317287168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448184.614482:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317287168:0@lo:400: 00010000:00080000:3.0:1789448184.614898:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8d500 x1876372317287296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448184.614909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317287296:0@lo:400: 00010000:00010000:2.0:1789448184.986708:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448186.015458:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448187.033507:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448188.061868:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448189.090827:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448189.724636:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317287424:0@lo:400: 00000100:00100000:1.0:1789448189.724745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448189.724808:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448189.724815:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317287808:0@lo:400: 00000100:00100000:1.0:1789448189.724846:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448189.724884:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317287552:0@lo:400: 00000100:00100000:1.0:1789448189.724913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448189.724932:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448189.724938:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317287680:0@lo:400: 00000100:00100000:1.0:1789448189.724958:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448189.724996:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287424 00000100:00100000:1.0:1789448189.725006:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287424 00000100:00100000:1.0:1789448189.725061:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789448189.725072:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3307:x1876372317287424:12345-0@lo:400: 00000100:00100000:1.0:1789448189.725131:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3307:x1876372317287424:12345-0@lo:400: Request processed in 60us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448189.725148:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789448189.725186:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287808 00000100:00100000:1.0:1789448189.725190:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287808 00000100:00100000:1.0:1789448189.725252:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448189.725259:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317287808:12345-0@lo:400: 00000100:00100000:1.0:1789448189.725293:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317287808:12345-0@lo:400: Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448189.725317:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448189.725345:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287552 00000100:00100000:1.0:1789448189.725349:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287552 00000100:00100000:1.0:1789448189.727627:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287680 00000100:00100000:1.0:1789448189.727641:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287680 00000100:00100000:1.0:1789448189.727689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448189.727702:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317287552:12345-0@lo:400: 00000100:00100000:1.0:1789448189.727804:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317287552:12345-0@lo:400: Request processed in 104us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448189.727812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448189.727829:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448189.727835:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317287680:12345-0@lo:400: 00000100:00100000:1.0:1789448189.727863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317287680:12345-0@lo:400: Request processed in 29us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448189.727869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789448189.727898:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448189.727903:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789448189.728828:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8c700 x1876372317287680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448189.728850:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317287680:0@lo:400: 00010000:00080000:1.0:1789448189.728865:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8fb80 x1876372317287552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448189.728873:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317287552:0@lo:400: 00010000:00080000:1.0:1789448189.728921:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8ed80 x1876372317287808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448189.728930:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317287808:0@lo:400: 00000100:00100000:1.0:1789448189.728971:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317287424:0@lo:400: 00000100:00100000:1.0:1789448189.734149:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448189.734189:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317287936:0@lo:13: 00000100:00100000:1.0:1789448189.734566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448189.734645:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317287936 00000100:00100000:1.0:1789448189.734656:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317287936 00000100:00100000:1.0:1789448189.734714:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448189.734725:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317287936:12345-0@lo:13: 00002000:00000024:1.0:1789448189.734793:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1789448189.736302:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9fb0b1180 x1876372317287936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448189.736335:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317287936:0@lo:13: 00000100:00100000:1.0:1789448189.737185:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317287936:12345-0@lo:13: Request processed in 2455us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448189.737198:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789448190.113402:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448191.131359:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448192.154600:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789448193.036483:0:7607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789448193.036489:0:7607:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789448193.036667:0:7607:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97d9e7a74000 00000020:01000004:2.0:1789448193.036692:0:7607:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789448193.036709:0:7607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789448193.036727:0:7607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97d8c19699c0) 00000020:00000080:2.0:1789448193.036745:0:7607:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789448193.122193:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789448193.122541:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:2.0:1789448193.177447:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789448193.212884:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789448193.222402:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789448193.222443:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789448193.222500:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789448193.222523:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789448193.223132:0:7607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789448193.223148:0:7607:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789448193.223163:0:7607:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe29566c2465f963e 00000020:01000004:2.0:1789448193.223174:0:7607:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789448193.223201:0:7607:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789448193.223206:0:7607:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789448193.223212:0:7607:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789448193.223283:0:7607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789448193.223288:0:7607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789448193.268149:0:7607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789448193.268210:0:7607:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789448193.268261:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789448193.268264:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448193.268265:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448193.268267:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448193.268268:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448193.268270:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448193.268272:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448193.268273:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789448193.268275:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789448193.268277:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448193.268285:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448193.268290:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789448193.268292:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448193.268293:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448193.268294:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448193.268295:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448193.268296:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448193.268297:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448193.268298:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448193.268299:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789448193.268299:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789448193.268300:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448193.268301:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448193.268338:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789448193.268362:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317288064:0@lo:253: 00000100:00100000:2.0:1789448193.268462:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.268878:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.269117:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288064 00000100:00100000:0.0:1789448193.269184:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288064 00000100:00100000:0.0:1789448193.269375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789448193.269389:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:7607:x1876372317288064:12345-0@lo:253: 20000000:01000000:0.0:1789448193.269440:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789448193.269445:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789448193.269452:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789448193.269457:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789448193.271063:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448193.272040:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789448193.272062:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789448193.272644:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789448193.272660:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789448193.272704:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789448193.272929:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789448193.273844:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789448193.273877:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789448193.273880:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789448193.273917:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789448193.273925:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789448193.274011:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789448193.274020:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789448193.274053:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789448193.274063:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789448193.274095:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789448193.274586:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789448193.275942:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789448193.275973:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789448193.275976:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789448193.276011:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789448193.276019:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789448193.276051:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789448193.276060:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789448193.276088:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789448193.276098:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789448193.276454:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789448193.276640:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789448193.276665:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789448193.276669:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789448193.276677:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789448193.276679:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789448193.276682:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789448193.276699:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789448193.276703:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789448193.276747:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789448193.276750:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789448193.277692:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789448193.278058:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789448193.278114:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789448193.279444:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789448193.279617:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789448193.279620:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789448193.280679:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789448193.280761:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789448193.280818:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789448193.281266:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789448193.281310:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789448193.281550:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789448193.281565:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789448193.281568:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789448193.286882:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789448193.287032:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789448193.287093:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789448193.288445:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789448193.288568:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789448193.288603:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789448193.288617:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789448193.288621:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789448193.289798:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789448193.289889:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789448193.289925:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789448193.290412:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789448193.290460:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789448193.290584:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1789448193.290609:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789448193.290636:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290660:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f958f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290668:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290691:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290698:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95ff expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290704:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9629 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290713:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290770:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290787:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 16 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.290805:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288192:0@lo:104: 00000100:00100000:1.0:1789448193.290899:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448193.290969:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.290977:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 16 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.290985:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288320:0@lo:104: 00010000:00010000:1.0:1789448193.291012:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.291031:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.291041:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288448:0@lo:104: 00010000:00010000:1.0:1789448193.291068:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.291077:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 16 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.291084:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288576:0@lo:104: 00010000:00010000:1.0:1789448193.291121:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448193.291362:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789448193.291384:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.291413:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.291422:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.291434:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288192 00000100:00100000:0.0:1789448193.291443:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288192 00000100:00100000:2.0:1789448193.291550:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288320 00000100:00100000:2.0:1789448193.291555:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288320 00010000:00010000:1.0:1789448193.291610:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.291620:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288704:0@lo:104: 00000100:00100000:1.0:1789448193.291649:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.291662:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c801ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.291726:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288448 00000100:00100000:0.0:1789448193.291731:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288448 00000100:00100000:0.0:1789448193.299732:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288576 00000100:00100000:0.0:1789448193.299752:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288576 00000100:00100000:0.0:1789448193.299791:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288704 00000100:00100000:0.0:1789448193.299794:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288704 00000100:00100000:0.0:1789448193.299812:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448193.299843:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:5827:x1876372317288192:12345-0@lo:104: 00010000:00010000:0.0:1789448193.299869:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300014:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448193.300020:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:5827:x1876372317288192:12345-0@lo:104: Request processed in 180us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.300028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448193.300081:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448193.300088:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5827:x1876372317288320:12345-0@lo:104: 00010000:00010000:0.0:1789448193.300096:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300210:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789448193.300239:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:5827:x1876372317288320:12345-0@lo:104: Request processed in 130us (8832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.300245:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448193.300262:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448193.300268:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5827:x1876372317288448:12345-0@lo:104: 00010000:00010000:0.0:1789448193.300275:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300304:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789448193.300308:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:5827:x1876372317288448:12345-0@lo:104: Request processed in 42us (8895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.300314:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448193.300327:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448193.300339:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:5827:x1876372317288576:12345-0@lo:104: 00010000:00010000:0.0:1789448193.300347:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300375:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789448193.300380:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:5827:x1876372317288576:12345-0@lo:104: Request processed in 42us (8957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.300385:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448193.300397:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448193.300403:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5827:x1876372317288704:12345-0@lo:104: 00010000:00010000:0.0:1789448193.300410:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300439:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789448193.300443:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5827:x1876372317288704:12345-0@lo:104: Request processed in 41us (8794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.300448:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789448193.300535:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789448193.300543:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300551:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1522200 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.300555:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300565:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.300572:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.300584:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.300633:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300640:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.300669:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300678:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f9629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9630 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300695:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789448193.300698:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300704:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0030600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.300707:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300713:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.300719:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.300724:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.300737:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300742:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.300756:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300762:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c0030600/0xe29566c2465f95ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9606 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300771:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789448193.300774:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300781:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.300783:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300790:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.300796:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.300801:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.300815:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300821:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.300839:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300846:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1800/0xe29566c2465f95e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300855:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448193.300864:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300871:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58200 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.300874:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300881:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.300887:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.300893:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.300907:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300913:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.300918:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300925:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae58200/0xe29566c2465f95b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95c0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300937:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448193.300940:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300945:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59a00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.300948:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300965:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.300971:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.300976:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.300990:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.300996:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.301000:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.301007:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f958f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9596 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.301023:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.301025:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.301027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.301036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448193.301054:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317289088:0@lo:103: 00000100:00100000:0.0:1789448193.301113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.301278:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288192:0@lo:104: 00000100:00100000:2.0:1789448193.301292:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288320:0@lo:104: 00000100:00100000:2.0:1789448193.301300:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288448:0@lo:104: 00000100:00100000:2.0:1789448193.301309:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288576:0@lo:104: 00000100:00100000:2.0:1789448193.301316:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1876372317288704:0@lo:104: 00010000:00010000:2.0:1789448193.301349:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.301455:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317288832:0@lo:103: 00000100:00100000:1.0:1789448193.301797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.301845:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317289344:0@lo:103: 00000100:00100000:1.0:1789448193.301867:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.301895:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448193.301900:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317288960:0@lo:103: 00000100:00100000:1.0:1789448193.301934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.301958:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317289216:0@lo:103: 00000100:00100000:1.0:1789448193.301976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.302133:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289088 00000100:00100000:3.0:1789448193.302143:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289088 00010000:00010000:3.0:1789448193.302179:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 17 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.302202:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288832 00000100:00100000:3.0:1789448193.302204:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288832 00010000:00010000:3.0:1789448193.302255:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 18 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.302268:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289344 00000100:00100000:3.0:1789448193.302271:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289344 00010000:00010000:3.0:1789448193.302284:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 19 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.302294:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317288960 00000100:00100000:3.0:1789448193.302303:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317288960 00010000:00010000:3.0:1789448193.302317:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 20 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.302328:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289216 00000100:00100000:3.0:1789448193.302331:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289216 00010000:00010000:3.0:1789448193.302340:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 21 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.302353:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448193.302361:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+21:3306:x1876372317289088:12345-0@lo:103: 00010000:00010000:3.0:1789448193.302376:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448193.302382:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 21 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302394:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 21 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302412:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58400/0xe29566c2465f95ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f95e3 expref: 21 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302431:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448193.302642:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789448193.302653:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789448193.302694:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3306:x1876372317289088:12345-0@lo:103: Request processed in 105us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.302704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448193.302723:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448193.302731:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3304:x1876372317288832:12345-0@lo:103: 00010000:00010000:3.0:1789448193.302739:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448193.302743:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302765:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302776:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9629 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302787:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448193.302827:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3304:x1876372317288832:12345-0@lo:103: Request processed in 97us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.302833:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448193.302847:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448193.302853:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3304:x1876372317289344:12345-0@lo:103: 00010000:00010000:3.0:1789448193.302861:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448193.302865:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 17 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302873:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 17 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302882:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0031a00/0xe29566c2465f9596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f958f expref: 17 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302892:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448193.302915:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3304:x1876372317289344:12345-0@lo:103: Request processed in 62us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.302920:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448193.302931:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448193.302936:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3304:x1876372317288960:12345-0@lo:103: 00010000:00010000:3.0:1789448193.302949:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448193.302953:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 15 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302962:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 15 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302971:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0031e00/0xe29566c2465f9606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f95ff expref: 15 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.302981:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448193.303003:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3304:x1876372317288960:12345-0@lo:103: Request processed in 67us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.303009:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448193.303021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448193.303028:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3307:x1876372317289216:12345-0@lo:103: 00010000:00010000:3.0:1789448193.303034:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448193.303038:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303046:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303055:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0030a00/0xe29566c2465f95c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f95b9 expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303067:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303077:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303112:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303121:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448193.303244:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317288960:0@lo:103: 00000100:00100000:1.0:1789448193.303255:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317288832:0@lo:103: 00000100:00100000:1.0:1789448193.303262:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317289344:0@lo:103: 00010000:00010000:3.0:1789448193.303337:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303344:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303351:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448193.303355:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303364:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303379:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.303390:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448193.303421:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3307:x1876372317289216:12345-0@lo:103: Request processed in 394us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.303428:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448193.303454:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317289216:0@lo:103: 00010000:00010000:1.0:1789448193.303560:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.303571:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.303579:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9645 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789448193.303596:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789448193.304613:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317289088:0@lo:103: 00000100:00100000:3.0:1789448193.347458:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:7607:x1876372317288064:12345-0@lo:253: Request processed in 78056us (78979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.347502:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448193.347621:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317288064:0@lo:253: 10000000:01000000:2.0:1789448193.347642:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789448193.347652:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789448193.347653:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448193.347655:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448193.347657:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789448193.347659:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448193.347660:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448193.347662:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448193.347663:0:7607:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789448193.347665:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448193.347666:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789448193.347746:0:7607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97d9e7a74000 from lustre-OST0001 10000000:01000000:0.0:1789448193.347781:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789448193.347784:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789448193.347793:0:7607:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97d9eaf63380 local copy 10000000:01000000:0.0:1789448193.347803:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789448193.347854:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.347868:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.347880:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448193.347901:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289472:0@lo:101: 00000100:00100000:0.0:1789448193.347945:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.348057:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368780 going to sleep for 11 seconds 00000100:00100000:1.0:1789448193.348311:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289472 00000100:00100000:1.0:1789448193.348320:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289472 00000100:00100000:1.0:1789448193.348413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789448193.348424:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+11:7607:x1876372317289472:12345-0@lo:101: 00010000:00010000:1.0:1789448193.348442:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448193.348459:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f964c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.348489:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f964c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.348515:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f964c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.348527:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58800, rc 0) 00000100:00100000:1.0:1789448193.348578:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317289472:12345-0@lo:101: Request processed in 156us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.348585:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789448193.348657:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289472:0@lo:101: 00010000:00010000:2.0:1789448193.348672:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.348682:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448193.348809:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289600:0@lo:501: 00000100:00100000:2.0:1789448193.348839:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.349011:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.349110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289600 00000100:00100000:0.0:1789448193.349115:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289600 00000100:00100000:0.0:1789448193.349213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789448193.349244:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317289600:12345-0@lo:501: 00000100:00100000:0.0:1789448193.349512:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317289600:12345-0@lo:501: Request processed in 269us (670us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448193.349520:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789448193.349658:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289600:0@lo:501: 10000000:01000000:2.0:1789448193.349674:0:7607:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789448193.349702:0:7607:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789448193.349707:0:7607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.349717:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.349724:0:7607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.349751:0:7607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448193.349778:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97d9e7a74000 10000000:01000000:2.0:1789448193.349783:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789448193.349790:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789448193.349793:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448193.349799:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789448193.349802:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789448193.349825:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.349833:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.349842:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448193.349858:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289728:0@lo:101: 00000100:00100000:2.0:1789448193.349889:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.349923:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00010000:00010000:0.0:1789448193.349979:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448193.349986:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.349995:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.350000:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.350010:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.350028:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.350034:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.350056:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.350062:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.350095:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.350119:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae32200/0xe29566c2465f964c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe29566c2465f9653 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.350232:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289728 00000100:00100000:3.0:1789448193.350238:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289728 00000100:00100000:3.0:1789448193.350276:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789448193.350284:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317289728:12345-0@lo:101: 00010000:00010000:3.0:1789448193.350294:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448193.350307:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f965a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.350326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f965a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.350336:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f965a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.350344:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523000, rc 0) 00000100:00100000:3.0:1789448193.350375:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317289728:12345-0@lo:101: Request processed in 92us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.350381:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1789448193.350498:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.350501:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.350503:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448193.350512:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448193.350525:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317289856:0@lo:103: 00000100:00100000:0.0:1789448193.350556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.350687:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289728:0@lo:101: 00010000:00010000:2.0:1789448193.350699:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.350707:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448193.350777:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289984:0@lo:501: 00000100:00100000:2.0:1789448193.350810:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.350832:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448193.350952:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289984 00000100:00100000:1.0:1789448193.350957:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289984 00000100:00100000:1.0:1789448193.350995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789448193.351002:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317289984:12345-0@lo:501: 00000100:00100000:1.0:1789448193.351369:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317289984:12345-0@lo:501: Request processed in 366us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.351377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448193.351528:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317289984:0@lo:501: 00000100:00100000:2.0:1789448193.351559:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290112:0@lo:503: 00000100:00100000:2.0:1789448193.351606:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.351636:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448193.351692:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290112 00000100:00100000:1.0:1789448193.351697:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290112 00000100:00100000:1.0:1789448193.351756:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448193.351764:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290112:12345-0@lo:503: 00000100:00100000:1.0:1789448193.351931:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290112:12345-0@lo:503: Request processed in 167us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.351938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789448193.352010:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317289856 00000100:00100000:3.0:1789448193.352015:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317289856 00000100:00100000:2.0:1789448193.352096:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290112:0@lo:503: 00000040:00080000:2.0:1789448193.352450:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448193.352533:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290240:0@lo:502: 00000100:00100000:2.0:1789448193.352577:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.352899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290240 00000100:00100000:0.0:1789448193.352905:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290240 00000100:00100000:0.0:1789448193.352932:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789448193.352940:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317290240:12345-0@lo:502: 00000100:00100000:0.0:1789448193.353185:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317290240:12345-0@lo:502: Request processed in 245us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.353193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789448193.353284:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448193.353297:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3304:x1876372317289856:12345-0@lo:103: 00010000:00010000:0.0:1789448193.353309:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448193.353331:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58800/0xe29566c2465f9653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f964c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.353351:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448193.353388:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3304:x1876372317289856:12345-0@lo:103: Request processed in 92us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.353394:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448193.353429:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317289856:0@lo:103: 00000100:00100000:3.0:1789448193.353608:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789448193.353622:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290240:0@lo:502: 00000040:00080000:3.0:1789448193.353908:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789448193.353963:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789448193.353996:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789448193.354042:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789448193.354073:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789448193.354119:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789448193.354253:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290368:0@lo:502: 00000100:00100000:3.0:1789448193.354301:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.354325:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.354455:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290368 00000100:00100000:0.0:1789448193.354462:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290368 00000100:00100000:0.0:1789448193.354533:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789448193.354541:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317290368:12345-0@lo:502: 00000100:00100000:0.0:1789448193.354710:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317290368:12345-0@lo:502: Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.354718:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789448193.354794:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290368:0@lo:502: 00000040:00080000:3.0:1789448193.354873:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789448193.354883:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789448193.355514:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789448193.355525:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789448193.355534:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448193.355537:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789448193.355542:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448193.355563:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97d9f49419c0) 00000020:00000080:3.0:1789448193.355593:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789448193.355601:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448193.355672:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9e7a74000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789448193.355680:0:7616:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789448193.355687:0:7616:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe29566c2465f966f 00010000:00010000:2.0:1789448193.361981:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789448193.362617:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789448193.364926:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789448193.365517:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789448193.369890:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789448193.370618:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789448193.372209:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789448193.372263:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448193.372272:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448193.372275:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789448193.372280:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448193.372284:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448193.372286:0:7616:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789448193.372289:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789448193.372291:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789448193.372371:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448193.372376:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448193.372377:0:7616:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789448193.372386:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789448193.372582:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789448193.372611:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789448193.372636:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.372649:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448193.372659:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9e7a74000 from 1 10000000:01000000:3.0:1789448193.372662:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448193.372711:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.372720:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.372745:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.372778:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290496:0@lo:101: 00000100:00100000:3.0:1789448193.372873:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.372930:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.372998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290496 00000100:00100000:2.0:1789448193.373007:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290496 00000100:00100000:2.0:1789448193.373066:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789448193.373077:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:7607:x1876372317290496:12345-0@lo:101: 00010000:00010000:2.0:1789448193.373093:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448193.373123:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9676 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.373258:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9676 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.373272:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9676 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.373281:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1800, rc 0) 00000100:00100000:2.0:1789448193.373327:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290496:12345-0@lo:101: Request processed in 251us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.373335:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789448193.373561:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290496:0@lo:101: 00010000:00010000:3.0:1789448193.373579:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.373589:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.373699:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290624:0@lo:501: 00000100:00100000:3.0:1789448193.373730:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.373812:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448193.379331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290624 00000100:00100000:1.0:1789448193.379352:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290624 00000100:00100000:1.0:1789448193.379462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789448193.379475:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290624:12345-0@lo:501: 00000100:00100000:1.0:1789448193.379866:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290624:12345-0@lo:501: Request processed in 393us (6134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.379881:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789448193.380012:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290624:0@lo:501: 00000100:00100000:0.0:1789448193.380075:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290752:0@lo:503: 00000100:00100000:0.0:1789448193.381288:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.382579:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.382671:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290752 00000100:00100000:2.0:1789448193.382682:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290752 00000100:00100000:2.0:1789448193.382738:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448193.382749:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290752:12345-0@lo:503: 00000100:00100000:2.0:1789448193.387388:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290752:12345-0@lo:503: Request processed in 4627us (6092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.387406:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448193.387541:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290752:0@lo:503: 00000040:00080000:2.0:1789448193.387969:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448193.388085:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290880:0@lo:502: 00000100:00100000:2.0:1789448193.388268:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.388308:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.388334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317290880 00000100:00100000:2.0:1789448193.388342:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317290880 00000100:00100000:2.0:1789448193.388380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789448193.388389:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290880:12345-0@lo:502: 00000100:00100000:2.0:1789448193.388641:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317290880:12345-0@lo:502: Request processed in 252us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.388648:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789448193.388691:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317290880:0@lo:502: 00000040:00080000:2.0:1789448193.388953:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789448193.389000:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789448193.389021:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291008:0@lo:502: 00000100:00100000:2.0:1789448193.389074:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.389089:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c7db0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.389114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291008 00000100:00100000:2.0:1789448193.389119:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291008 00000100:00100000:2.0:1789448193.389530:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789448193.389537:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317291008:12345-0@lo:502: 00000100:00100000:2.0:1789448193.389681:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317291008:12345-0@lo:502: Request processed in 144us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.389688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789448193.389845:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291008:0@lo:502: 00000040:00080000:0.0:1789448193.389968:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789448193.389980:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789448193.390677:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448193.390689:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448193.390700:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789448193.390709:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9e7a74000 00000020:00000080:0.0:1789448193.390711:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448193.390735:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448193.390738:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448193.390739:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789448193.390742:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789448193.390976:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789448193.391000:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448193.391071:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.391098:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448193.391338:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789448193.391343:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97d9e7a74000 10000000:01000000:2.0:1789448193.391347:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97d9e7a74000 10000000:01000000:2.0:1789448193.391353:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448193.391361:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9e7a74000 from 1 10000000:01000000:2.0:1789448193.391364:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789448193.391407:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.391416:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.391428:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448193.391453:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce824a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291136:0@lo:101: 00000100:00100000:2.0:1789448193.391518:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.391597:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d2e37240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448193.391745:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291136 00000100:00100000:3.0:1789448193.391754:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291136 00000100:00100000:3.0:1789448193.391802:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789448193.391813:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317291136:12345-0@lo:101: 00010000:00010000:3.0:1789448193.391829:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448193.391845:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9684 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.391875:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9684 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.391900:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9684 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.391910:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523e00, rc 0) 00000100:00100000:3.0:1789448193.391990:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291136:12345-0@lo:101: Request processed in 179us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.391997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448193.392197:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce824a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291136:0@lo:101: 00010000:00010000:2.0:1789448193.392213:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448193.392521:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448193.392647:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce824a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291264:0@lo:501: 00000100:00100000:2.0:1789448193.392682:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.392748:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d2e37240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448193.392802:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291264 00000100:00100000:3.0:1789448193.392808:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291264 00000100:00100000:3.0:1789448193.392873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789448193.392883:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291264:12345-0@lo:501: 00000100:00100000:3.0:1789448193.393293:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291264:12345-0@lo:501: Request processed in 409us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.393301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789448193.393399:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce824a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291264:0@lo:501: 00000100:00100000:0.0:1789448193.393437:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291392:0@lo:503: 00000100:00100000:0.0:1789448193.393482:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.393620:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.393687:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291392 00000100:00100000:2.0:1789448193.393692:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291392 00000100:00100000:2.0:1789448193.393715:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789448193.393721:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291392:12345-0@lo:503: 00000100:00100000:2.0:1789448193.393889:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291392:12345-0@lo:503: Request processed in 167us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.393896:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789448193.393973:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291392:0@lo:503: 00000040:00080000:0.0:1789448193.394344:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448193.394413:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291520:0@lo:502: 00000100:00100000:0.0:1789448193.394450:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448193.394478:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448193.394590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291520 00000100:00100000:2.0:1789448193.394595:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291520 00000100:00100000:2.0:1789448193.394616:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789448193.394622:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291520:12345-0@lo:502: 00000100:00100000:2.0:1789448193.394796:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291520:12345-0@lo:502: Request processed in 173us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.394803:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789448193.394918:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291520:0@lo:502: 00000040:00080000:0.0:1789448193.397399:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789448193.397510:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789448193.397548:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789448193.397597:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789448193.397632:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789448193.397713:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789448193.397749:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789448193.397781:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789448193.397847:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789448193.397886:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789448193.397918:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789448193.397964:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789448193.398012:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789448193.398063:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789448193.398540:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789448193.398593:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789448193.398626:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789448193.398699:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789448193.398740:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789448193.398776:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789448193.398824:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789448193.398861:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789448193.398893:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789448193.398943:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789448193.398980:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789448193.399014:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789448193.399079:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789448193.399212:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789448193.399655:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789448193.399718:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789448193.399758:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789448193.399794:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789448193.399830:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789448193.399898:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789448193.399939:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789448193.400003:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789448193.400043:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789448193.400120:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291648:0@lo:502: 00000100:00100000:2.0:1789448193.400466:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.400553:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d2e370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448193.400599:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291648 00000100:00100000:3.0:1789448193.400610:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291648 00000100:00100000:3.0:1789448193.400723:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789448193.400736:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291648:12345-0@lo:502: 00000100:00100000:3.0:1789448193.401026:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317291648:12345-0@lo:502: Request processed in 292us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.401035:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789448193.401153:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317291648:0@lo:502: 00000040:00080000:2.0:1789448193.401277:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789448193.401289:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789448193.402067:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789448193.402086:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97d8c196b380) 00000020:00000080:2.0:1789448193.402173:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789448193.404525:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9e7a74000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789448193.404538:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9e7a74000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789448193.404542:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9e7a74000 3 00010000:00080000:2.0:1789448193.404590:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9f56c8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789448193.407593:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789448193.407881:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789448193.407926:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789448193.407942:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe29566c2465f9699 00000100:00080000:3.0:1789448193.407956:0:7621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448193.407969:0:7621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97d9f56c8800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448193.408026:0:7621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9eada0a80 x1876372317291776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448193.408057:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789448193.408237:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317291776:0@lo:38: 00000100:00100000:2.0:1789448193.408323:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.408401:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291776 00000100:00100000:2.0:1789448193.408410:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291776 00000100:00100000:2.0:1789448193.408453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448193.408462:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317291776:12345-0@lo:38: 00010000:00080000:2.0:1789448193.408492:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1789448193.408545:0:5833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe29566c2465f96a0 00000004:00100000:2.0:1789448193.408563:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789448193.408604:0:5833:0:(import.c:65:import_set_state_nolock()) ffff97d9f56cf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448193.408666:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876372317291776:12345-0@lo:38: Request processed in 203us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.408673:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789448193.408716:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eada0a80 x1876372317291776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.408739:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448193.408748:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789448193.408757:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789448193.408761:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789448193.408764:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9f56c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789448193.408771:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317291776:0@lo:38: 00000100:00100000:2.0:1789448193.409123:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448193.409144:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317292160:0@lo:400: 00000100:00100000:2.0:1789448193.409182:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.409362:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292160 00000100:00100000:1.0:1789448193.409367:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292160 00000100:00100000:1.0:1789448193.409428:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448193.409437:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317292160:12345-0@lo:400: 00000100:00100000:1.0:1789448193.409484:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317292160:12345-0@lo:400: Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.409491:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448193.409573:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317292032:0@lo:400: 00000100:00100000:3.0:1789448193.409604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.409623:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448193.409629:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317291904:0@lo:400: 00000100:00100000:3.0:1789448193.409651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.409677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292032 00000100:00100000:3.0:1789448193.409682:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292032 00000100:00100000:3.0:1789448193.409708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317291904 00000100:00100000:3.0:1789448193.409711:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317291904 00000100:00100000:3.0:1789448193.409726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448193.409733:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317292032:12345-0@lo:400: 00000100:00100000:3.0:1789448193.409766:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317292032:12345-0@lo:400: Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.409772:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448193.409788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448193.409794:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317291904:12345-0@lo:400: 00000100:00100000:3.0:1789448193.409822:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317291904:12345-0@lo:400: Request processed in 28us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448193.409827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789448193.409859:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8c700 x1876372317291904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448193.409871:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317291904:0@lo:400: 00010000:00080000:3.0:1789448193.409882:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8fb80 x1876372317292032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448193.409902:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317292032:0@lo:400: 00000040:00080000:3.0:1789448193.410088:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1789448193.410378:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448193.410383:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789448193.410408:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9eac8ed80 x1876372317292160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.410418:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317292160:0@lo:400: 00000100:00100000:2.0:1789448193.410484:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1876372317292288:0@lo:901: 00000100:00100000:2.0:1789448193.410523:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448193.410558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292288 00000100:00100000:2.0:1789448193.410562:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292288 00000100:00100000:2.0:1789448193.410598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448193.410605:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1876372317292288:12345-0@lo:901: 00000100:00100000:2.0:1789448193.410937:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1876372317292288:12345-0@lo:901: Request processed in 331us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448193.410944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789448193.410963:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448193.410975:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b540 going to sleep for 11 seconds 00010000:00080000:2.0:1789448193.410996:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9ce827800 x1876372317292288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789448209 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.411007:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1876372317292288:0@lo:901: 00000020:01000000:1.0:1789448193.414334:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789448193.414395:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789448193.415900:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448193.415924:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789448193.416000:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789448193.416003:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448193.416005:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448193.416006:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448193.416008:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448193.416010:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448193.416012:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448193.416014:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789448193.416015:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789448193.416017:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448193.416019:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789448193.416024:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789448193.416027:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789448193.416028:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448193.416029:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448193.416031:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448193.416036:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448193.416037:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448193.416038:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448193.416039:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789448193.416040:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789448193.416041:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448193.416042:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789448193.416076:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789448193.416109:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317292416:0@lo:253: 00000100:00100000:1.0:1789448193.416207:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.416281:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafb5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.418789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292416 00000100:00100000:0.0:1789448193.418811:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292416 00000100:00100000:0.0:1789448193.418891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789448193.418903:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7607:x1876372317292416:12345-0@lo:253: 20000000:01000000:0.0:1789448193.418963:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789448193.418983:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789448193.452798:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789448193.452825:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789448193.452894:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789448193.452901:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789448193.452933:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.452958:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.452969:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.453024:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.453042:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 14 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448193.453062:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317292544:0@lo:104: 00000100:00100000:3.0:1789448193.453171:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.453299:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448193.454916:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292544 00000100:00100000:0.0:1789448193.454936:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292544 00000100:00100000:0.0:1789448193.455004:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448193.455018:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317292544:12345-0@lo:104: 00010000:00010000:0.0:1789448193.455040:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455192:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448193.455199:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:5849:x1876372317292544:12345-0@lo:104: Request processed in 185us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.455207:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789448193.455259:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448193.455266:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455276:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1522c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448193.455281:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455291:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448193.455300:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448193.455308:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448193.455350:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455357:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448193.455377:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455386:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f95f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.455421:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.455423:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448193.455425:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448193.455543:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317292672:0@lo:103: 00000100:00100000:2.0:1789448193.455597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448193.455808:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876372317292544:0@lo:104: 00010000:00010000:3.0:1789448193.455836:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448193.456207:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292672 00000100:00100000:0.0:1789448193.456243:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292672 00010000:00010000:0.0:1789448193.456270:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 15 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448193.456302:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448193.456309:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3305:x1876372317292672:12345-0@lo:103: 00010000:00010000:0.0:1789448193.456345:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448193.456352:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 15 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456363:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 15 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456379:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0030200/0xe29566c2465f95f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f95f1 expref: 15 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456395:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456405:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789448193.456421:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003521355s 00010000:00010000:0.0:1789448193.456427:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456445:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456453:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456461:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456467:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448193.456472:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456480:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456493:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448193.456504:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448193.456550:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3305:x1876372317292672:12345-0@lo:103: Request processed in 241us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.456558:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789448193.456691:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317292672:0@lo:103: 00010000:00010000:3.0:1789448193.456750:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.456770:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448193.456776:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523c00/0xe29566c2465f96a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448193.464050:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:7607:x1876372317292416:12345-0@lo:253: Request processed in 45135us (47828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.464071:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789448193.464291:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7607:1876372317292416:0@lo:253: 10000000:01000000:1.0:1789448193.464314:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789448193.464318:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448193.464320:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448193.464322:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448193.464323:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448193.464325:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448193.464327:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448193.464328:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448193.464330:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789448193.464331:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789448193.464334:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448193.464335:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789448193.464356:0:7607:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789448193.469681:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448193.469875:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789448193.470118:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448193.470443:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789448193.470641:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448193.470873:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789448193.472552:0:7607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789448193.699392:0:7607:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789448193.699404:0:7607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789448193.699471:0:7607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789448193.699549:0:7607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789448193.699568:0:7607:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789448193.699610:0:7607:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789448194.201980:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448194.841647:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317292800:0@lo:13: 00000100:00100000:2.0:1789448194.841746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.841848:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292800 00000100:00100000:2.0:1789448194.841858:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292800 00000100:00100000:2.0:1789448194.841919:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789448194.841932:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317292800:12345-0@lo:13: 00002000:00000024:2.0:1789448194.841983:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448194.842041:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317292800:12345-0@lo:13: Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.842049:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789448194.842121:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce827800 x1876372317292800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448194.842145:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317292800:0@lo:13: 00010000:00010000:0.0:1789448195.226625:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448196.250770:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448197.273932:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448198.297364:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448198.428877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317293312:0@lo:400: 00000100:00100000:0.0:1789448198.428969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.429121:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317293056:0@lo:400: 00000100:00100000:1.0:1789448198.429163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.429198:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448198.429198:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789448198.429204:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317293184:0@lo:400: 00000100:00100000:0.0:1789448198.429204:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317292928:0@lo:400: 00000100:00100000:2.0:1789448198.429310:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293056 00000100:00100000:2.0:1789448198.429319:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293056 00000100:00100000:2.0:1789448198.429369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448198.429378:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317293056:12345-0@lo:400: 00000100:00100000:1.0:1789448198.432015:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.432015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.432097:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317293440:0@lo:400: 00000100:00100000:3.0:1789448198.432111:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317292928 00000100:00100000:3.0:1789448198.432122:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317292928 00000100:00100000:0.0:1789448198.432164:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448198.432178:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789448198.432189:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3306:x1876372317292928:12345-0@lo:400: 00000100:00100000:3.0:1789448198.432274:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3306:x1876372317292928:12345-0@lo:400: Request processed in 87us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.432282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789448198.432292:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317292928:0@lo:400: 00000100:00100000:3.0:1789448198.432321:0:5834:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448198.432329:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789448198.432479:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448198.432488:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293184 00000100:00100000:3.0:1789448198.432491:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293184 00000100:00100000:3.0:1789448198.432532:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448198.432536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293440 00000100:00100000:3.0:1789448198.432539:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293440 00000100:00100000:3.0:1789448198.432552:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448198.432558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448198.432564:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317293184:12345-0@lo:400: 00000100:00100000:3.0:1789448198.432612:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317293184:12345-0@lo:400: Request processed in 47us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.432619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448198.432630:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448198.432635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789448198.432647:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317293440:12345-0@lo:400: 00000100:00100000:3.0:1789448198.432682:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317293440:12345-0@lo:400: Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.432688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789448198.432722:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b2d80 x1876372317293440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448198.432735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317293440:0@lo:400: 00010000:00080000:1.0:1789448198.433892:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b2300 x1876372317293184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448198.433908:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317293184:0@lo:400: 00000100:00100000:1.0:1789448198.433952:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293312 00000100:00100000:1.0:1789448198.433957:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293312 00000100:00080000:2.0:1789448198.434152:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448198.434158:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448198.434278:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317293056:12345-0@lo:400: Request processed in 4899us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.434288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789448198.435329:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448198.435346:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317293312:12345-0@lo:400: 00000100:00100000:1.0:1789448198.435429:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317293312:12345-0@lo:400: Request processed in 89us (6460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448198.435436:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789448198.437065:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b1c00 x1876372317293056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448198.437087:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317293056:0@lo:400: 00010000:00080000:0.0:1789448198.437151:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b1f80 x1876372317293312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448198.437174:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317293312:0@lo:400: 10000000:01000000:3.0:1789448198.942514:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789448198.942525:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c336e800 from 30 10000000:01000000:3.0:1789448198.942533:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789448198.942588:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448198.942602:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448198.942616:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448198.942647:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293568:0@lo:101: 00000100:00100000:3.0:1789448198.942737:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.942787:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293568 00000100:00100000:3.0:1789448198.942795:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.942797:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293568 00000100:00100000:0.0:1789448198.942853:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789448198.942863:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317293568:12345-0@lo:101: 00010000:00010000:0.0:1789448198.942879:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448198.942896:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f96ae expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.942924:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f96ae expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.942937:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96ae expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.942948:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32a00, rc 0) 00000100:00100000:0.0:1789448198.943182:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317293568:12345-0@lo:101: Request processed in 319us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.945631:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789448198.945746:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293568:0@lo:101: 00010000:00010000:3.0:1789448198.945778:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448198.945792:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448198.945904:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293696:0@lo:501: 00000100:00100000:3.0:1789448198.945978:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448198.946016:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448198.946035:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293696 00000100:00100000:3.0:1789448198.946041:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293696 00000100:00100000:3.0:1789448198.946098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789448198.946108:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317293696:12345-0@lo:501: 00000100:00100000:3.0:1789448198.946490:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317293696:12345-0@lo:501: Request processed in 381us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.946498:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789448198.946535:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293696:0@lo:501: 00000100:00100000:3.0:1789448198.946566:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293824:0@lo:503: 00000100:00100000:3.0:1789448198.946604:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448198.946620:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448198.946764:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293824 00000100:00100000:3.0:1789448198.946768:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293824 00000100:00100000:3.0:1789448198.946790:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789448198.946797:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317293824:12345-0@lo:503: 00000100:00100000:3.0:1789448198.947104:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317293824:12345-0@lo:503: Request processed in 306us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.947111:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789448198.947145:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317293824:0@lo:503: 00000100:00100000:1.0:1789448198.949908:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7854:1876372317293952:0@lo:502: 00000100:00100000:1.0:1789448198.951181:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.951261:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.951327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317293952 00000100:00100000:0.0:1789448198.951338:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317293952 00000100:00100000:0.0:1789448198.951403:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789448198.951414:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7854:x1876372317293952:12345-0@lo:502: 00000100:00100000:0.0:1789448198.951950:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7854:x1876372317293952:12345-0@lo:502: Request processed in 536us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.951969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789448198.952434:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7854:1876372317293952:0@lo:502: 00000100:00100000:1.0:1789448198.952569:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7854:1876372317294080:0@lo:502: 00000100:00100000:1.0:1789448198.952610:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.952645:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.952687:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294080 00000100:00100000:0.0:1789448198.952700:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294080 00000100:00100000:0.0:1789448198.952737:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789448198.952744:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7854:x1876372317294080:12345-0@lo:502: 00000100:00100000:0.0:1789448198.952971:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:7854:x1876372317294080:12345-0@lo:502: Request processed in 227us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.953037:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789448198.953249:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7854:1876372317294080:0@lo:502: 00000040:00080000:1.0:1789448198.953269:0:7854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789448198.953350:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789448198.953372:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789448198.953383:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448198.953396:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448198.953406:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789448198.953409:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789448198.953412:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789448198.953446:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448198.953455:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448198.953465:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448198.953476:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294208:0@lo:101: 00000100:00100000:1.0:1789448198.953689:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.953745:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.953961:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294208 00000100:00100000:0.0:1789448198.953967:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294208 00000100:00100000:0.0:1789448198.954312:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789448198.954322:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317294208:12345-0@lo:101: 00010000:00010000:0.0:1789448198.954337:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448198.954357:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f96bc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.954386:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f96bc expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.954399:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96bc expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.954409:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33400, rc 0) 00000100:00100000:0.0:1789448198.954454:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294208:12345-0@lo:101: Request processed in 134us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.954461:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789448198.954549:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294208:0@lo:101: 00010000:00010000:2.0:1789448198.954567:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.954578:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448198.954643:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294336:0@lo:501: 00000100:00100000:2.0:1789448198.954674:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448198.960664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294336 00000100:00100000:1.0:1789448198.960688:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294336 00000100:00100000:1.0:1789448198.960765:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789448198.960777:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294336:12345-0@lo:501: 00000100:00100000:2.0:1789448198.961263:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448198.961761:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294336:12345-0@lo:501: Request processed in 984us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448198.961770:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789448198.961901:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294336:0@lo:501: 00000100:00100000:2.0:1789448198.965127:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294464:0@lo:503: 00000100:00100000:2.0:1789448198.965238:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.965287:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448198.965616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294464 00000100:00100000:1.0:1789448198.965624:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294464 00000100:00100000:1.0:1789448198.965672:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789448198.965683:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294464:12345-0@lo:503: 00000100:00100000:1.0:1789448198.966621:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294464:12345-0@lo:503: Request processed in 936us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448198.966631:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789448198.967174:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294464:0@lo:503: 00000100:00100000:3.0:1789448198.967589:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7855:1876372317294592:0@lo:502: 00000100:00100000:3.0:1789448198.967647:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448198.967698:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.967754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294592 00000100:00100000:0.0:1789448198.967762:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294592 00000100:00100000:0.0:1789448198.967801:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789448198.967810:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:7855:x1876372317294592:12345-0@lo:502: 00000100:00100000:0.0:1789448198.968427:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:7855:x1876372317294592:12345-0@lo:502: Request processed in 616us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.968441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789448198.968602:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7855:1876372317294592:0@lo:502: 00000020:01000000:3.0:1789448198.968631:0:7855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448198.968641:0:7855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448198.968644:0:7855:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448198.968651:0:7855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448198.968653:0:7855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789448198.968670:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7855:1876372317294720:0@lo:502: 00000100:00100000:3.0:1789448198.968704:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448198.968736:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448198.970600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294720 00000100:00100000:0.0:1789448198.970612:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294720 00000100:00100000:0.0:1789448198.970658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789448198.970667:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:7855:x1876372317294720:12345-0@lo:502: 00000100:00100000:0.0:1789448198.970924:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:7855:x1876372317294720:12345-0@lo:502: Request processed in 258us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448198.970932:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789448198.970964:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7855:1876372317294720:0@lo:502: 00000020:01000000:3.0:1789448198.970998:0:7855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448198.971007:0:7855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448198.971009:0:7855:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789448198.971015:0:7855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789448198.971429:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789448198.971454:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789448198.971467:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.971480:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448198.971491:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789448198.971495:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c6cee800 from 30 10000000:01000000:0.0:1789448198.971498:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789448198.971537:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.971546:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.971556:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448198.971575:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294848:0@lo:101: 00000100:00100000:0.0:1789448198.971623:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.971691:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafb5000 going to sleep for 11 seconds 00000100:00100000:3.0:1789448198.971724:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294848 00000100:00100000:3.0:1789448198.971730:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294848 00000100:00100000:2.0:1789448198.972603:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789448198.972614:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317294848:12345-0@lo:101: 00010000:00010000:2.0:1789448198.972630:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448198.972643:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f96ca expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.972666:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f96ca expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.972684:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96ca expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.972691:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0a00, rc 0) 00000100:00100000:2.0:1789448198.972731:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317294848:12345-0@lo:101: Request processed in 119us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.972738:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789448198.972757:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294848:0@lo:101: 00010000:00010000:0.0:1789448198.972773:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448198.972783:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448198.972841:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294976:0@lo:501: 00000100:00100000:0.0:1789448198.972866:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.972900:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.973056:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317294976 00000100:00100000:2.0:1789448198.973062:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317294976 00000100:00100000:3.0:1789448198.973118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789448198.973129:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317294976:12345-0@lo:501: 00000100:00100000:3.0:1789448198.973450:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317294976:12345-0@lo:501: Request processed in 323us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.973457:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789448198.973570:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317294976:0@lo:501: 00000100:00100000:0.0:1789448198.973599:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295104:0@lo:503: 00000100:00100000:0.0:1789448198.973636:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.973657:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.974308:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295104 00000100:00100000:2.0:1789448198.974315:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295104 00000100:00100000:2.0:1789448198.974363:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789448198.974371:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317295104:12345-0@lo:503: 00000100:00100000:2.0:1789448198.974600:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317295104:12345-0@lo:503: Request processed in 229us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.974608:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789448198.974624:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295104:0@lo:503: 00000100:00100000:2.0:1789448198.975015:0:7856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7856:1876372317295232:0@lo:502: 00000100:00100000:2.0:1789448198.975076:0:7856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.975135:0:7856:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448198.975316:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295232 00000100:00100000:3.0:1789448198.975330:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295232 00000100:00100000:3.0:1789448198.975397:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789448198.975405:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:7856:x1876372317295232:12345-0@lo:502: 00000100:00100000:3.0:1789448198.975608:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:7856:x1876372317295232:12345-0@lo:502: Request processed in 203us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.975621:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789448198.977398:0:7856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7856:1876372317295232:0@lo:502: 00000100:00100000:2.0:1789448198.977480:0:7856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7856:1876372317295360:0@lo:502: 00000100:00100000:2.0:1789448198.977539:0:7856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.977577:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295360 00000100:00100000:2.0:1789448198.977584:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295360 00000100:00100000:2.0:1789448198.977620:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789448198.977629:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:7856:x1876372317295360:12345-0@lo:502: 00000100:00100000:2.0:1789448198.977873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:7856:x1876372317295360:12345-0@lo:502: Request processed in 244us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.977881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789448198.977931:0:7856:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.977943:0:7856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7856:1876372317295360:0@lo:502: 00000040:00080000:2.0:1789448198.977971:0:7856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789448198.979659:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789448198.979696:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789448198.979710:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.979725:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448198.979736:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789448198.979740:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9c6cee800 from 5 10000000:01000000:2.0:1789448198.979743:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789448198.979789:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.979798:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.979809:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448198.979832:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295488:0@lo:101: 00000100:00100000:2.0:1789448198.979902:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.979949:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.979990:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295488 00000100:00100000:2.0:1789448198.979998:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295488 00000100:00100000:2.0:1789448198.980058:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789448198.980067:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317295488:12345-0@lo:101: 00010000:00010000:2.0:1789448198.980082:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448198.980112:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465f96df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f96d8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980139:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465f96df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f96d8 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980150:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465f96df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96d8 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980159:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2800, rc 0) 00000100:00100000:2.0:1789448198.980203:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317295488:12345-0@lo:101: Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.980209:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789448198.980276:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295488:0@lo:101: 00010000:00010000:2.0:1789448198.980290:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980300:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448198.980353:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295616:0@lo:256: 00000100:00100000:2.0:1789448198.980385:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.980398:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.980408:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295616 00000100:00100000:2.0:1789448198.980417:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295616 00000100:00100000:2.0:1789448198.980434:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789448198.980439:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317295616:12345-0@lo:256: 20000000:01000000:2.0:1789448198.980453:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789448198.980473:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789448198.980477:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789448198.980553:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317295616:12345-0@lo:256: Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.980561:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789448198.980588:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295616:0@lo:256: 10000000:01000000:2.0:1789448198.980628:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448198.980633:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980642:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448198.980650:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789448198.980652:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789448198.980655:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789448198.980670:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980677:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980684:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448198.980695:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295744:0@lo:101: 00000100:00100000:2.0:1789448198.980724:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.980737:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.980747:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295744 00000100:00100000:2.0:1789448198.980751:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295744 00000100:00100000:2.0:1789448198.980768:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789448198.980774:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317295744:12345-0@lo:101: 00010000:00010000:2.0:1789448198.980780:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448198.980788:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f96e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980802:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980811:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980817:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3400, rc 0) 00000100:00100000:2.0:1789448198.980840:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317295744:12345-0@lo:101: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.980846:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789448198.980870:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295744:0@lo:101: 00010000:00010000:2.0:1789448198.980880:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448198.980889:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448198.980934:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295872:0@lo:501: 00000100:00100000:2.0:1789448198.980964:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.980976:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.980987:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317295872 00000100:00100000:2.0:1789448198.980990:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317295872 00000100:00100000:2.0:1789448198.981006:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789448198.981012:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317295872:12345-0@lo:501: 00000100:00100000:2.0:1789448198.981332:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317295872:12345-0@lo:501: Request processed in 318us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.981339:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789448198.981366:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317295872:0@lo:501: 00000100:00100000:2.0:1789448198.981391:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296000:0@lo:503: 00000100:00100000:2.0:1789448198.981427:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448198.981439:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.981449:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296000 00000100:00100000:2.0:1789448198.981452:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296000 00000100:00100000:2.0:1789448198.981468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789448198.981473:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317296000:12345-0@lo:503: 00000100:00100000:2.0:1789448198.981754:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317296000:12345-0@lo:503: Request processed in 279us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448198.981760:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789448198.981794:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296000:0@lo:503: 00000100:00100000:0.0:1789448198.987832:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7857:1876372317296128:0@lo:502: 00000100:00100000:0.0:1789448198.987942:0:7857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448198.988096:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafb5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448198.988181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296128 00000100:00100000:2.0:1789448198.988190:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296128 00000100:00100000:3.0:1789448198.989534:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789448198.989554:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:7857:x1876372317296128:12345-0@lo:502: 00000100:00100000:3.0:1789448198.990102:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:7857:x1876372317296128:12345-0@lo:502: Request processed in 555us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448198.990112:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789448198.990454:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7857:1876372317296128:0@lo:502: 00000020:01000000:0.0:1789448198.990497:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789448198.990507:0:7857:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789448198.990517:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448198.990520:0:7857:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789448198.990524:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789448198.990529:0:7857:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:0.0:1789448198.990558:0:7857:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789448198.990570:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448198.990589:0:7857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97d9ceaab380) 00000020:00000080:0.0:1789448198.990617:0:7857:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789448198.990623:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789448198.990729:0:7857:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789448198.990736:0:7857:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789448198.990742:0:7857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465f96fb 00010000:00080000:0.0:1789448198.990779:0:7857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9e7a71000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1789448198.991185:0:7857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789448198.991728:0:7857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789448198.991743:0:7857:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789448198.999935:0:7857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789448199.000739:0:7857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789448199.000798:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789448199.000863:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789448199.007741:0:7858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448199.007756:0:7858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789448199.014779:0:7857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448199.014801:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789448199.014849:0:7857:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789448199.014880:0:7857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465f9702 00000100:00080000:3.0:1789448199.014894:0:7857:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448199.014911:0:7857:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9e7a71000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448199.016110:0:7857:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9eada0e00 x1876372317296256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448199.016139:0:7857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789448199.016245:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448199.016252:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448199.016254:0:7857:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789448199.016257:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448199.016262:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448199.016263:0:7857:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448199.016266:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448199.016274:0:7857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789448199.016322:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317296256:0@lo:8: 00000100:00100000:2.0:1789448199.016418:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448199.017739:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296256 00000100:00100000:1.0:1789448199.017756:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296256 00000100:00100000:1.0:1789448199.017963:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448199.017990:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317296256:12345-0@lo:8: 00000100:00100000:3.0:1789448199.017992:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7857:1876372317296384:0@lo:502: 00010000:00080000:1.0:1789448199.018032:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1789448199.018078:0:6672:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465f9709 00000100:00100000:3.0:1789448199.018184:0:7857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1789448199.018201:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97d9fad2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789448199.018207:0:6672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789448199.018212:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789448199.018233:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5a80 going to sleep for 11 seconds 00002000:00100000:1.0:1789448199.018394:0:6672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789448199.018604:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448199.018637:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d9fad28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448199.018709:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876372317296256:12345-0@lo:8: Request processed in 720us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448199.018718:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448199.018877:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296384 00000100:00100000:3.0:1789448199.018883:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296384 00000100:00100000:3.0:1789448199.018917:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789448199.018923:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:7857:x1876372317296384:12345-0@lo:502: 00010000:00080000:1.0:1789448199.020386:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0e00 x1876372317296256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448199.020404:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789448199.020415:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789448199.020426:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789448199.020433:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789448199.020437:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9e7a71000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789448199.020455:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789448199.020462:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317296256:0@lo:8: 00000100:00100000:3.0:1789448199.021284:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:7857:x1876372317296384:12345-0@lo:502: Request processed in 2355us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448199.021297:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:3.0:1789448199.021847:0:7858:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789448199.024771:0:7858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220727549921ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789448199.025242:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:7857:1876372317296384:0@lo:502: 00000020:01000000:2.0:1789448199.025311:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448199.025321:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448199.025324:0:7857:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789448199.025330:0:7857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789448199.026461:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789448199.026490:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789448199.026504:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.026519:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448199.026532:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789448199.026535:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97d9eaf63380 from 1 10000000:01000000:3.0:1789448199.026539:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789448199.026586:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.026595:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.026617:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448199.026643:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296512:0@lo:101: 00000100:00100000:3.0:1789448199.026735:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448199.026781:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448199.026804:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296512 00000100:00100000:3.0:1789448199.026813:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296512 00000100:00100000:3.0:1789448199.026862:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789448199.026871:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317296512:12345-0@lo:101: 00010000:00010000:3.0:1789448199.026889:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448199.026904:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9710 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.026937:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.026953:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.028209:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1522e00, rc 0) 00000100:00100000:3.0:1789448199.028291:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317296512:12345-0@lo:101: Request processed in 1418us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448199.028300:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789448199.029243:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296512:0@lo:101: 00010000:00010000:3.0:1789448199.029274:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.029300:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448199.030204:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296640:0@lo:501: 00000100:00100000:3.0:1789448199.030281:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448199.030336:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448199.032120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296640 00000100:00100000:2.0:1789448199.032134:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296640 00000100:00100000:2.0:1789448199.032206:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789448199.032234:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317296640:12345-0@lo:501: 00000100:00100000:2.0:1789448199.032560:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317296640:12345-0@lo:501: Request processed in 344us (2278us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789448199.032569:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789448199.032600:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317296640:0@lo:501: 10000000:01000000:3.0:1789448199.032640:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789448199.032652:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448199.032664:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789448199.118979:0:7859:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789448199.121006:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317296896:0@lo:7: 00000100:00100000:2.0:1789448199.121209:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448199.121282:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448199.121304:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317296768:0@lo:13: 00000100:00100000:2.0:1789448199.121403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448199.121451:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296768 00000100:00100000:2.0:1789448199.121461:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296768 00000100:00100000:2.0:1789448199.121524:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448199.121536:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317296768:12345-0@lo:13: 00002000:00000024:2.0:1789448199.121576:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789448199.121624:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317296768:12345-0@lo:13: Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448199.121631:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789448199.121656:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789448199.121686:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825180 x1876372317296768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448199.121713:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317296768:0@lo:13: 00000100:00100000:1.0:1789448199.121966:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317296896 00000100:00100000:1.0:1789448199.121971:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317296896 00000100:00100000:1.0:1789448199.122008:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448199.122017:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1876372317296896:12345-0@lo:7: 00002000:00080000:1.0:1789448199.133863:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789448199.133883:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789448199.134019:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1876372317296896:12345-0@lo:7: Request processed in 11997us (12803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448199.134031:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789448199.137714:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825c00 x1876372317296896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789448215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448199.137741:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317296896:0@lo:7: 00000004:00080000:2.0:1789448199.137762:0:7859:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789448199.137815:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297024:0@lo:5: 00000100:00100000:2.0:1789448199.137885:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448199.137939:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448199.138191:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297024 00000100:00100000:1.0:1789448199.138202:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297024 00000100:00100000:1.0:1789448199.138300:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448199.138465:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7859:x1876372317297024:12345-0@lo:5: 00002000:00080000:1.0:1789448199.138506:0:6672:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789448199.138511:0:6672:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789448199.138921:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7859:x1876372317297024:12345-0@lo:5: Request processed in 611us (1034us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789448199.138929:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789448199.143464:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825c00 x1876372317297024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448199.143985:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297024:0@lo:5: 00000004:00080000:3.0:1789448199.144008:0:7859:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789448199.144190:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297152:0@lo:700: 00000100:00100000:3.0:1789448199.144293:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448199.144352:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448199.145587:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297152 00000100:00100000:1.0:1789448199.145602:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297152 00000100:00100000:1.0:1789448199.145676:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448199.145688:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7859:x1876372317297152:12345-0@lo:700: 00000100:00100000:1.0:1789448199.145747:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1876372317297280:0@lo:700: 00000100:00100000:1.0:1789448199.145818:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448199.145844:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f53683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448199.145864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297280 00000100:00100000:1.0:1789448199.145866:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297280 00000100:00100000:1.0:1789448199.145889:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448199.145894:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1876372317297280:12345-0@lo:700: 00000004:00080000:3.0:1789448199.195171:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789448199.285473:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789448199.303259:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1876372317297280:12345-0@lo:700: Request processed in 157353us (157430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448199.303279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789448199.303624:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eac8e680 x1876372317297280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789448215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448199.303642:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1876372317297280:0@lo:700: 40000000:02000000:1.0:1789448199.303659:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:1.0:1789448199.329668:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789448199.385689:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789448199.385713:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789448199.386711:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7859:x1876372317297152:12345-0@lo:700: Request processed in 241015us (242407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448199.386750:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789448199.387095:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0000 x1876372317297152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789448215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448199.387109:0:7859:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789448199.387135:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297152:0@lo:700: 00000004:02000040:3.0:1789448199.451258:0:7859:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789448199.455868:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297408:0@lo:5: 00000100:00100000:3.0:1789448199.455963:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448199.456073:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297408 00000100:00100000:1.0:1789448199.456084:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297408 00000100:00100000:1.0:1789448199.456160:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448199.456171:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7859:x1876372317297408:12345-0@lo:5: 00000100:00100000:3.0:1789448199.456260:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5cc0 going to sleep for 11 seconds 00002000:00080000:3.0:1789448199.469832:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789448199.469862:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789448199.478476:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1876372317297408:12345-0@lo:5: Request processed in 22295us (22500us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1789448199.478803:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0000 x1876372317297408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448199.478829:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1876372317297408:0@lo:5: 00000004:00080000:0.0:1789448199.478848:0:7859:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789448199.479591:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448199.966639:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448199.966672:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317297536:0@lo:13: 00000100:00100000:1.0:1789448199.966765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448199.966905:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297536 00000100:00100000:1.0:1789448199.966917:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297536 00000100:00100000:1.0:1789448199.968257:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448199.968273:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317297536:12345-0@lo:13: 00002000:00000024:1.0:1789448199.968646:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448199.968732:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317297536:12345-0@lo:13: Request processed in 464us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448199.968740:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789448199.968770:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eac8e680 x1876372317297536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448199.968796:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317297536:0@lo:13: 00010000:00010000:0.0:1789448200.346410:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448201.369513:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448202.165129:0:7975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789448202.399180:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448203.417819:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448204.061863:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317297664:0@lo:400: 00000100:00100000:0.0:1789448204.061959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448204.062339:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448204.062346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317297792:0@lo:400: 00000100:00100000:0.0:1789448204.062374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448204.062607:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317298304:0@lo:400: 00000100:00100000:2.0:1789448204.062635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448204.062652:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448204.062656:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317298176:0@lo:400: 00000100:00100000:2.0:1789448204.062670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448204.062687:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317297920:0@lo:400: 00000100:00100000:2.0:1789448204.062706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448204.062727:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448204.062744:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298048:0@lo:400: 00000100:00100000:2.0:1789448204.062767:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448204.062805:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298304 00000100:00100000:2.0:1789448204.062815:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298304 00000100:00100000:2.0:1789448204.062878:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298048 00000100:00100000:2.0:1789448204.062881:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298048 00000100:00100000:2.0:1789448204.062896:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448204.062904:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317298304:12345-0@lo:400: 00000100:00100000:2.0:1789448204.062967:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317298304:12345-0@lo:400: Request processed in 63us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.062975:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448204.063015:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448204.063022:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317298048:12345-0@lo:400: 00000100:00100000:2.0:1789448204.063065:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317298048:12345-0@lo:400: Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.063072:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448204.063091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297792 00000100:00100000:2.0:1789448204.063094:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297792 00000100:00100000:2.0:1789448204.063115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298176 00000100:00100000:2.0:1789448204.063116:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298176 00000100:00100000:2.0:1789448204.063124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297920 00000100:00100000:2.0:1789448204.063126:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297920 00000100:00100000:2.0:1789448204.063135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448204.063139:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317297792:12345-0@lo:400: 00000100:00100000:2.0:1789448204.063173:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317297792:12345-0@lo:400: Request processed in 34us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.063177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448204.063184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448204.063188:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317298176:12345-0@lo:400: 00000100:00100000:2.0:1789448204.063207:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317298176:12345-0@lo:400: Request processed in 18us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.063212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448204.063262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448204.063267:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317297920:12345-0@lo:400: 00000100:00100000:2.0:1789448204.063289:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317297920:12345-0@lo:400: Request processed in 23us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.063293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789448204.063308:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448204.063312:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448204.063313:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789448204.063335:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825c00 x1876372317298176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448204.063347:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317298176:0@lo:400: 00010000:00080000:2.0:1789448204.063354:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01c50380 x1876372317298304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448204.063360:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317298304:0@lo:400: 00010000:00080000:2.0:1789448204.063385:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825f80 x1876372317298048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448204.063390:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298048:0@lo:400: 00010000:00080000:2.0:1789448204.063395:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce826d80 x1876372317297920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448204.063400:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317297920:0@lo:400: 00010000:00080000:0.0:1789448204.063573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce827b80 x1876372317297792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448204.063581:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317297792:0@lo:400: 00000100:00100000:2.0:1789448204.064546:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317297664 00000100:00100000:2.0:1789448204.064555:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317297664 00000100:00100000:2.0:1789448204.064592:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789448204.064597:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317297664:12345-0@lo:400: 00000100:00100000:2.0:1789448204.064657:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317297664:12345-0@lo:400: Request processed in 59us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448204.064670:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789448204.065363:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317297664:0@lo:400: 00010000:00010000:1.0:1789448204.441642:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448204.574197:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298432:0@lo:13: 00000100:00100000:0.0:1789448204.574319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448204.574441:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298432 00000100:00100000:0.0:1789448204.574451:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298432 00000100:00100000:0.0:1789448204.574510:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448204.574520:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317298432:12345-0@lo:13: 00002000:00000024:0.0:1789448204.574568:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448204.574616:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317298432:12345-0@lo:13: Request processed in 98us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448204.574624:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789448204.574670:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b1880 x1876372317298432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448204.574691:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298432:0@lo:13: 00000001:00080000:1.0:1789448204.646794:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789448205.083210:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448205.088725:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298560:0@lo:13: 00000100:00100000:2.0:1789448205.088843:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448205.093494:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298560 00000100:00100000:0.0:1789448205.093709:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298560 00000100:00100000:0.0:1789448205.093880:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448205.093895:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317298560:12345-0@lo:13: 00002000:00000024:0.0:1789448205.093949:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448205.094078:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317298560:12345-0@lo:13: Request processed in 187us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448205.094086:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789448205.094207:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eac8fb80 x1876372317298560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448205.094274:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317298560:0@lo:13: 00010000:00010000:2.0:1789448205.465525:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448206.498580:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448207.517122:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448208.132305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448208.132437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254144 00000100:00100000:2.0:1789448208.132451:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254144 00000100:00100000:2.0:1789448208.132622:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:2.0:1789448208.132633:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1876372295254144:12345-192.168.202.54@tcp:250: 00010000:00080000:2.0:1789448208.132669:0:5828:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 84b086e6-5128-47e9-ae2c-494c126c747d@192.168.202.54@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1789448208.132706:0:5828:0:(genops.c:1384:class_connect()) connect: client 84b086e6-5128-47e9-ae2c-494c126c747d, cookie 0xe29566c2465f971e 00000100:00080000:2.0:1789448208.132888:0:5828:0:(import.c:65:import_set_state_nolock()) ffff97d9f56c8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448208.132986:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+5:2347:x1876372295254144:12345-192.168.202.54@tcp:250: Request processed in 353us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448208.133005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:2.0:1789448208.152573:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.152704:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254272 00000100:00100000:0.0:1789448208.152719:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254272 00000100:00100000:0.0:1789448208.152803:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:0.0:1789448208.152816:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+5:5577:x1876372295254272:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1789448208.152839:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448208.152864:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eb5e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448208.152905:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448208.152920:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448208.152933:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32200, rc 0) 00000100:00100000:0.0:1789448208.153025:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+6:5577:x1876372295254272:12345-192.168.202.54@tcp:101: Request processed in 211us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448208.153032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:1.0:1789448208.159779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.160045:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254400 00000100:00100000:0.0:1789448208.160060:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254400 00000100:00100000:0.0:1789448208.161688:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:0.0:1789448208.161711:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+6:5577:x1876372295254400:12345-192.168.202.54@tcp:501: 00000100:00100000:0.0:1789448208.162264:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+6:5577:x1876372295254400:12345-192.168.202.54@tcp:501: Request processed in 559us (2550us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448208.162275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789448208.165035:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448208.165203:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254528 00000100:00100000:1.0:1789448208.165235:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254528 00000100:00100000:1.0:1789448208.165304:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:1.0:1789448208.165317:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+6:5577:x1876372295254528:12345-192.168.202.54@tcp:101: 00010000:00010000:1.0:1789448208.165339:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448208.165373:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eb65 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.165408:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.165422:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.165433:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58200, rc 0) 00000100:00100000:1.0:1789448208.165536:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+7:5577:x1876372295254528:12345-192.168.202.54@tcp:101: Request processed in 221us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.165545:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1789448208.169991:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.170080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254656 00000100:00100000:0.0:1789448208.170094:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254656 00000100:00100000:0.0:1789448208.170168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1789448208.170180:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+7:5577:x1876372295254656:12345-192.168.202.54@tcp:501: 00000100:00100000:1.0:1789448208.170601:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+8:5577:x1876372295254656:12345-192.168.202.54@tcp:501: Request processed in 421us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.170610:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1789448208.174564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448208.174683:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254784 00000100:00100000:1.0:1789448208.174695:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254784 00000100:00100000:1.0:1789448208.174803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:1.0:1789448208.174814:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:5577:x1876372295254784:12345-192.168.202.54@tcp:503: 00000100:00100000:1.0:1789448208.175321:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:5577:x1876372295254784:12345-192.168.202.54@tcp:503: Request processed in 508us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.175328:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1789448208.186512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448208.186561:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295254912 00000100:00100000:3.0:1789448208.186576:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295254912 00000100:00100000:3.0:1789448208.186645:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1789448208.186657:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+8:5596:x1876372295254912:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1789448208.187145:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+8:5596:x1876372295254912:12345-192.168.202.54@tcp:502: Request processed in 487us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448208.187157:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:0.0:1789448208.225752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.225801:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255040 00000100:00100000:0.0:1789448208.225813:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255040 00000100:00100000:0.0:1789448208.225882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1789448208.225896:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:5596:x1876372295255040:12345-192.168.202.54@tcp:502: 00000100:00100000:0.0:1789448208.227080:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:5596:x1876372295255040:12345-192.168.202.54@tcp:502: Request processed in 1180us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448208.227092:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1789448208.235532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448208.235621:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255168 00000100:00100000:1.0:1789448208.235635:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255168 00000100:00100000:1.0:1789448208.235706:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:1.0:1789448208.235718:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+8:5577:x1876372295255168:12345-192.168.202.54@tcp:101: 00010000:00010000:1.0:1789448208.235741:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448208.235779:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58000/0xe29566c2465f9733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eb8f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.235820:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58000/0xe29566c2465f9733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb8f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.235833:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58000/0xe29566c2465f9733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb8f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.235845:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58000, rc 0) 00000100:00100000:1.0:1789448208.235911:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+9:5577:x1876372295255168:12345-192.168.202.54@tcp:101: Request processed in 194us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.235918:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:3.0:1789448208.240256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.240366:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255296 00000100:00100000:0.0:1789448208.240378:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255296 00000100:00100000:0.0:1789448208.240439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1789448208.240450:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+9:5577:x1876372295255296:12345-192.168.202.54@tcp:256: 20000000:01000000:0.0:1789448208.240481:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789448208.240513:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789448208.240518:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789448208.240521:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789448208.240524:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789448208.252677:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+9:5577:x1876372295255296:12345-192.168.202.54@tcp:256: Request processed in 12210us (12421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.252696:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1789448208.255249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448208.255390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255424 00000100:00100000:1.0:1789448208.255402:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255424 00000100:00100000:1.0:1789448208.255501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:1.0:1789448208.255515:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:5577:x1876372295255424:12345-192.168.202.54@tcp:101: 00010000:00010000:1.0:1789448208.255539:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448208.255565:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eb96 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.255598:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.255610:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448208.255634:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59e00, rc 0) 00000100:00100000:1.0:1789448208.255739:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5577:x1876372295255424:12345-192.168.202.54@tcp:101: Request processed in 227us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448208.255746:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:0.0:1789448208.257520:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448208.257563:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255552 00000100:00100000:3.0:1789448208.257575:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255552 00000100:00100000:3.0:1789448208.257632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1789448208.257646:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5577:x1876372295255552:12345-192.168.202.54@tcp:501: 00000100:00100000:3.0:1789448208.258014:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5577:x1876372295255552:12345-192.168.202.54@tcp:501: Request processed in 369us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448208.258025:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:1.0:1789448208.261538:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448208.261615:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255680 00000100:00100000:0.0:1789448208.261628:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255680 00000100:00100000:0.0:1789448208.261692:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:0.0:1789448208.261713:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5577:x1876372295255680:12345-192.168.202.54@tcp:503: 00000100:00100000:0.0:1789448208.262402:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5577:x1876372295255680:12345-192.168.202.54@tcp:503: Request processed in 688us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448208.262413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1789448208.265455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448208.265504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255808 00000100:00100000:3.0:1789448208.265517:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255808 00000100:00100000:3.0:1789448208.265584:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1789448208.265597:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5601:x1876372295255808:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1789448208.266120:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5601:x1876372295255808:12345-192.168.202.54@tcp:502: Request processed in 525us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448208.266127:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1789448208.268835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448208.269052:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295255936 00000100:00100000:2.0:1789448208.269066:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295255936 00000100:00100000:2.0:1789448208.269130:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:2.0:1789448208.269140:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5601:x1876372295255936:12345-192.168.202.54@tcp:502: 00000100:00100000:2.0:1789448208.269408:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5601:x1876372295255936:12345-192.168.202.54@tcp:502: Request processed in 268us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448208.269423:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:3.0:1789448208.276186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448208.276275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256064 00000100:00100000:3.0:1789448208.276287:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256064 00000100:00100000:3.0:1789448208.276344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789448208.276356:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1876372295256064:12345-192.168.202.54@tcp:38: 00010000:00080000:3.0:1789448208.276393:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1789448208.276455:0:5834:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f9741 00000004:00100000:3.0:1789448208.276490:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1789448208.276497:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789448208.303118:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97d9fa812000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448208.303214:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295256064:12345-192.168.202.54@tcp:38: Request processed in 26858us (27039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448208.303258:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00010000:00010000:1.0:1789448208.539247:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448209.070503:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448209.070553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448209.071293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256192 00000100:00100000:3.0:1789448209.071325:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256192 00000100:00100000:3.0:1789448209.071420:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256320 00000100:00100000:3.0:1789448209.071423:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256320 00000100:00100000:3.0:1789448209.071453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789448209.071464:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:0:x1876372295256192:12345-192.168.202.54@tcp:41: 00000004:00000024:3.0:1789448209.071522:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789448209.072038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789448209.072055:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:5577:x1876372295256320:12345-192.168.202.54@tcp:41: 00000004:00000024:1.0:1789448209.072073:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789448209.073013:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:0:x1876372295256192:12345-192.168.202.54@tcp:41: Request processed in 1538us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.073028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00080000:2.0:1789448209.073304:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448209.074146:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5577:x1876372295256320:12345-192.168.202.54@tcp:41: Request processed in 2087us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448209.074158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448209.084178:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448209.084287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256448 00000100:00100000:3.0:1789448209.084301:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256448 00000100:00100000:3.0:1789448209.084632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:3.0:1789448209.084645:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5577:x1876372295256448:12345-192.168.202.54@tcp:40: 00000100:00100000:3.0:1789448209.084781:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5577:x1876372295256448:12345-192.168.202.54@tcp:40: Request processed in 138us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.084789:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789448209.098616:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448209.098721:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256960 00000100:00100000:3.0:1789448209.098735:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256960 00000100:00100000:3.0:1789448209.098818:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:3.0:1789448209.098831:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295256960:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1789448209.098941:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295256960:12345-192.168.202.54@tcp:400: Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.098950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1789448209.100131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448209.100167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448209.100237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448209.100313:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256576 00000100:00100000:2.0:1789448209.100323:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256576 00000100:00100000:2.0:1789448209.100361:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256704 00000100:00100000:2.0:1789448209.100364:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256704 00000100:00100000:2.0:1789448209.100376:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448209.100384:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295256576:12345-192.168.202.54@tcp:8: 00010000:00080000:2.0:1789448209.100420:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1789448209.100461:0:6673:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f9748 00002000:00100000:2.0:1789448209.100476:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7263448-abed-44d6-a5e0-4aa81ee22270/ffff97d9f56cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789448209.100506:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789448209.100927:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789448209.100973:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d9f56ca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448209.101164:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295256576:12345-192.168.202.54@tcp:8: Request processed in 778us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448209.101174:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448209.101205:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789448209.101211:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295256704:12345-192.168.202.54@tcp:8: 00010000:00080000:2.0:1789448209.101262:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1789448209.101282:0:6673:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f974f 00002000:00100000:2.0:1789448209.101289:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7263448-abed-44d6-a5e0-4aa81ee22270/ffff97d9f56ca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789448209.101323:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789448209.101536:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789448209.101552:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d9f56ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448209.101574:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295256704:12345-192.168.202.54@tcp:8: Request processed in 362us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448209.101582:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789448209.102099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295256832 00000100:00100000:0.0:1789448209.102110:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295256832 00000100:00100000:0.0:1789448209.102154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789448209.102163:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5577:x1876372295256832:12345-192.168.202.54@tcp:33: 00000004:00080000:0.0:1789448209.160060:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 57775us 00000100:00100000:3.0:1789448209.178527:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317298944:0@lo:400: 00000100:00100000:3.0:1789448209.178615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448209.178690:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448209.178703:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317299072:0@lo:400: 00000100:00100000:3.0:1789448209.178734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448209.178776:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298944 00000100:00100000:3.0:1789448209.178786:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298944 00000100:00100000:3.0:1789448209.178851:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448209.178862:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317298944:12345-0@lo:400: 00000100:00100000:3.0:1789448209.178933:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317298944:12345-0@lo:400: Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.178941:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789448209.179003:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0e00 x1876372317298944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448209.179020:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317298944:0@lo:400: 00000100:00100000:2.0:1789448209.179213:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317298816:0@lo:400: 00000100:00100000:2.0:1789448209.179274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.179302:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317299328:0@lo:400: 00000100:00100000:2.0:1789448209.179323:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.179347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789448209.179353:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317298688:0@lo:400: 00000100:00100000:2.0:1789448209.179379:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.179397:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317299200:0@lo:400: 00000100:00100000:2.0:1789448209.179417:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.179445:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299072 00000100:00100000:2.0:1789448209.179449:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299072 00000100:00100000:2.0:1789448209.179483:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299328 00000100:00100000:2.0:1789448209.179486:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299328 00000100:00100000:2.0:1789448209.179501:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448209.179507:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317299072:12345-0@lo:400: 00000100:00100000:2.0:1789448209.179546:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317299072:12345-0@lo:400: Request processed in 40us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448209.179552:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448209.179568:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448209.179573:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317299328:12345-0@lo:400: 00000100:00100000:2.0:1789448209.179615:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317299328:12345-0@lo:400: Request processed in 42us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448209.179621:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789448209.179641:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448209.179646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448209.179648:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789448209.179670:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6300 x1876372317299328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448209.179679:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789448209.179691:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317299328:0@lo:400: 00000100:00100000:0.0:1789448209.179886:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298688 00000100:00100000:0.0:1789448209.179891:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298688 00000100:00100000:0.0:1789448209.179934:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789448209.179942:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317298688:12345-0@lo:400: 00000100:00100000:0.0:1789448209.179995:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317298688:12345-0@lo:400: Request processed in 54us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.180001:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789448209.180032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317298688:0@lo:400: 00000100:00100000:0.0:1789448209.180049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317298816 00000100:00100000:0.0:1789448209.180052:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317298816 00000100:00100000:0.0:1789448209.180073:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299200 00000100:00100000:0.0:1789448209.180076:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299200 00000100:00100000:0.0:1789448209.180161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789448209.180168:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317298816:12345-0@lo:400: 00000100:00100000:0.0:1789448209.180203:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317298816:12345-0@lo:400: Request processed in 36us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.180251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789448209.180264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448209.180270:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317299200:12345-0@lo:400: 00000100:00100000:0.0:1789448209.180307:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317299200:12345-0@lo:400: Request processed in 38us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.180313:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789448209.180328:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789448209.180349:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc7800 x1876372317299200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448209.180358:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317299200:0@lo:400: 00010000:00080000:0.0:1789448209.180368:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0a80 x1876372317298816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448209.180376:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317298816:0@lo:400: 00010000:00080000:3.0:1789448209.181375:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc4000 x1876372317299072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448209.181393:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317299072:0@lo:400: 00000004:00200000:0.0:1789448209.231455:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789448209.231616:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5577:x1876372295256832:12345-192.168.202.54@tcp:33: Request processed in 129446us (131389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.231629:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00010000:00010000:2.0:1789448209.561719:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448209.646543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448209.646722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257088 00000100:00100000:0.0:1789448209.646737:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257088 00000100:00100000:0.0:1789448209.646876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789448209.646889:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5618:x1876372295257088:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1789448209.646930:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448209.650167:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465f9756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ebc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650304:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650320:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650337:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448209.650376:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448209.650380:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448209.650396:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650425:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465f9756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650447:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc0 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448209.650455:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448209.650457:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448209.650460:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448209.650533:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:5618:x1876372295257088:12345-192.168.202.54@tcp:101: Request processed in 3647us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.650542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448209.690291:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448209.690330:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317299456:0@lo:13: 00000100:00100000:1.0:1789448209.690464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448209.690796:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299456 00000100:00100000:0.0:1789448209.690808:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299456 00000100:00100000:0.0:1789448209.690888:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448209.690900:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317299456:12345-0@lo:13: 00002000:00000024:0.0:1789448209.690944:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448209.691025:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317299456:12345-0@lo:13: Request processed in 127us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.691033:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789448209.691290:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b1880 x1876372317299456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448209.691315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317299456:0@lo:13: 00000100:00100000:2.0:1789448210.202772:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317299584:0@lo:13: 00000100:00100000:2.0:1789448210.202873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448210.205103:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299584 00000100:00100000:1.0:1789448210.205122:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299584 00000100:00100000:1.0:1789448210.207325:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448210.207355:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317299584:12345-0@lo:13: 00002000:00000024:1.0:1789448210.207397:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448210.207552:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317299584:12345-0@lo:13: Request processed in 211us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448210.207560:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789448210.211392:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eafd2680 x1876372317299584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.211427:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317299584:0@lo:13: 00010000:00010000:1.0:1789448210.585711:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448211.609486:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448212.021711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448212.021820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257216 00000100:00100000:3.0:1789448212.021835:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257216 00000100:00080000:0.0:1789448212.022032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448212.022141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789448212.022158:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:5671:x1876372295257216:12345-192.168.202.54@tcp:41: 00000004:00000024:2.0:1789448212.022256:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789448212.022345:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:5671:x1876372295257216:12345-192.168.202.54@tcp:41: Request processed in 192us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448212.022353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789448212.028668:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448212.029063:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257344 00000100:00100000:1.0:1789448212.029076:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257344 00000100:00100000:1.0:1789448212.029179:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448212.029193:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5671:x1876372295257344:12345-192.168.202.54@tcp:13: 00002000:00000024:1.0:1789448212.029301:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448212.029392:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5671:x1876372295257344:12345-192.168.202.54@tcp:13: Request processed in 202us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448212.029400:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00080000:0.0:1789448212.029674:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448212.034834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448212.035273:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257472 00000100:00100000:2.0:1789448212.035306:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257472 00000100:00100000:2.0:1789448212.035460:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1789448212.035474:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5671:x1876372295257472:12345-192.168.202.54@tcp:13: 00002000:00000024:2.0:1789448212.035527:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448212.035614:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7263448-abed-44d6-a5e0-4aa81ee22270+6:5671:x1876372295257472:12345-192.168.202.54@tcp:13: Request processed in 143us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448212.035622:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:0.0:1789448212.036842:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789448212.363337:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00010000:00010000:1.0:1789448212.634676:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.657649:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789448213.967040:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000001:00100000:1.0:1789448213.968263:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000100:00100000:1.0:1789448214.298465:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317299968:0@lo:400: 00000100:00100000:1.0:1789448214.298567:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.298678:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448214.298687:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317300096:0@lo:400: 00000100:00100000:1.0:1789448214.298719:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.298754:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317299840:0@lo:400: 00000100:00100000:1.0:1789448214.298778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.298797:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317300352:0@lo:400: 00000100:00100000:1.0:1789448214.298821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.298859:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789448214.298882:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317299712:0@lo:400: 00000100:00100000:1.0:1789448214.299262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.299292:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317300224:0@lo:400: 00000100:00100000:1.0:1789448214.299493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448214.299563:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299968 00000100:00100000:1.0:1789448214.299575:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299968 00000100:00100000:0.0:1789448214.299878:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299840 00000100:00100000:0.0:1789448214.299883:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299840 00000100:00100000:0.0:1789448214.300124:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300224 00000100:00100000:0.0:1789448214.300129:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300224 00000100:00100000:0.0:1789448214.300166:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789448214.300177:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317299840:12345-0@lo:400: 00000100:00100000:0.0:1789448214.300281:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317299840:12345-0@lo:400: Request processed in 106us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448214.300290:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789448214.300310:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448214.300466:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300096 00000100:00100000:2.0:1789448214.300471:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300096 00000100:00100000:2.0:1789448214.300507:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300352 00000100:00100000:2.0:1789448214.300511:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300352 00000100:00100000:2.0:1789448214.300528:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789448214.300536:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317300096:12345-0@lo:400: 00000100:00100000:2.0:1789448214.300583:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317300096:12345-0@lo:400: Request processed in 48us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448214.300603:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789448214.300626:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789448214.300633:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317300352:12345-0@lo:400: 00000100:00100000:2.0:1789448214.300660:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317300352:12345-0@lo:400: Request processed in 29us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448214.300666:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789448214.300721:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b1f80 x1876372317300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448214.300738:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317300096:0@lo:400: 00000100:00100000:2.0:1789448214.300784:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317299712 00000100:00100000:2.0:1789448214.300789:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317299712 00000100:00100000:2.0:1789448214.300841:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789448214.300847:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317299712:12345-0@lo:400: 00000100:00100000:2.0:1789448214.300895:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317299712:12345-0@lo:400: Request processed in 48us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448214.300901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789448214.301262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789448214.301269:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317299968:12345-0@lo:400: 00000100:00100000:2.0:1789448214.301710:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317299968:0@lo:400: 00000100:00080000:2.0:1789448214.301766:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448214.301770:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448214.301773:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448214.301796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317299712:0@lo:400: 00000100:00100000:2.0:1789448214.301809:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317299840:0@lo:400: 00010000:00080000:2.0:1789448214.301822:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b2d80 x1876372317300352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448214.301832:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317300352:0@lo:400: 00000100:00100000:1.0:1789448214.302076:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317299968:12345-0@lo:400: Request processed in 48us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448214.302085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789448214.302161:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317300224:12345-0@lo:400: 00000100:00100000:0.0:1789448214.302260:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317300224:12345-0@lo:400: Request processed in 1944us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448214.302267:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789448214.302790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317300224:0@lo:400: 00000100:00100000:1.0:1789448214.466138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448214.466179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448214.466230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448214.466264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448214.466282:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257856 00000100:00100000:1.0:1789448214.466289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257728 00000100:00100000:1.0:1789448214.466294:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257728 00000100:00100000:0.0:1789448214.466295:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257856 00000100:00100000:0.0:1789448214.466366:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257984 00000100:00100000:0.0:1789448214.466370:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257984 00000100:00100000:2.0:1789448214.467390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295257600 00000100:00100000:2.0:1789448214.467402:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295257600 00000100:00100000:2.0:1789448214.467458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1789448214.467470:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2348:x1876372295257600:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789448214.467560:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2348:x1876372295257600:12345-192.168.202.54@tcp:400: Request processed in 93us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448214.467568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1789448214.467773:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789448214.467782:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295257856:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789448214.467819:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295257856:12345-192.168.202.54@tcp:400: Request processed in 38us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448214.467836:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789448214.469052:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789448214.469066:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295257984:12345-192.168.202.54@tcp:400: 00000100:00100000:0.0:1789448214.469137:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295257984:12345-192.168.202.54@tcp:400: Request processed in 74us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448214.469143:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:0.0:1789448214.469163:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448214.469169:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448214.469172:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448214.470307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789448214.470321:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295257728:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1789448214.470426:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295257728:12345-192.168.202.54@tcp:400: Request processed in 108us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448214.470434:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00010000:00010000:3.0:1789448214.684112:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448214.810115:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448214.813477:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317300480:0@lo:13: 00000100:00100000:1.0:1789448214.813586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448214.820073:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300480 00000100:00100000:3.0:1789448214.820105:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300480 00000100:00100000:3.0:1789448214.820289:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448214.820304:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317300480:12345-0@lo:13: 00002000:00000024:3.0:1789448214.820356:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448214.820485:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317300480:12345-0@lo:13: Request processed in 186us (6899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448214.820494:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789448214.820616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b2300 x1876372317300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448214.820643:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317300480:0@lo:13: 00000001:02000400:1.0:1789448215.084253:0:8279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789448215.325850:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448215.325884:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317300608:0@lo:13: 00000100:00100000:2.0:1789448215.325980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448215.326050:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300608 00000100:00100000:2.0:1789448215.326060:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300608 00000100:00100000:2.0:1789448215.326110:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448215.326120:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317300608:12345-0@lo:13: 00002000:00000024:2.0:1789448215.326166:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448215.326211:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317300608:12345-0@lo:13: Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448215.326237:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789448215.326281:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01c51c00 x1876372317300608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448215.326300:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317300608:0@lo:13: 00010000:00010000:2.0:1789448215.705694:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448216.751982:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448217.756639:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448218.780458:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789448219.008388:0:8427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedf7df030 20000000:00000080:0.0:1789448219.008405:0:8427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d9fffcb800 uarg=0000000000000000 20000000:01000000:0.0:1789448219.008453:0:8427:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789448219.008455:0:8427:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789448219.008458:0:8427:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789448219.008463:0:8427:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789448219.008468:0:8427:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789448219.008482:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789448219.008484:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789448219.008826:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789448219.008830:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789448219.015700:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789448219.016388:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789448219.016460:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789448219.016497:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789448219.016509:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789448219.017252:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789448219.018517:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789448219.018936:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789448219.018987:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789448219.019053:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789448219.019067:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789448219.019069:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789448219.019949:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789448219.020533:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789448219.020581:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789448219.020619:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789448219.020632:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789448219.020635:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789448219.021544:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789448219.026617:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789448219.026694:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789448219.026732:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789448219.026751:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789448219.026778:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026798:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f965a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026807:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026814:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96ae expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026821:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96bc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026829:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96ca expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026849:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026856:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9710 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026876:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026885:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026892:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026933:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.026950:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 9 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.026966:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300736:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448219.027184:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.027192:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 9 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.027200:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300864:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448219.037160:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.037180:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 18 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.037194:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300992:0@lo:104: 00000100:00100000:0.0:1789448219.037286:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448219.038117:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038129:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038139:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301120:0@lo:104: 00000100:00100000:0.0:1789448219.038174:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448219.038293:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038302:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 18 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038310:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301248:0@lo:104: 00010000:00010000:0.0:1789448219.038431:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038440:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038449:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301376:0@lo:104: 00010000:00010000:0.0:1789448219.038485:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038493:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 18 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038502:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301504:0@lo:104: 00010000:00010000:0.0:1789448219.038525:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038534:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038541:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301632:0@lo:104: 00010000:00010000:0.0:1789448219.038565:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.038573:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.038581:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301760:0@lo:104: 00000100:00100000:0.0:1789448219.038597:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789448219.039295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448219.039334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448219.039368:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258112 00000100:00100000:1.0:1789448219.039376:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258112 00010000:00010000:1.0:1789448219.039409:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 10 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448219.039436:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258240 00000100:00100000:1.0:1789448219.039440:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258240 00010000:00010000:1.0:1789448219.039451:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 11 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448219.039470:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789448219.039478:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+11:2350:x1876372295258112:12345-192.168.202.54@tcp:103: 00010000:00010000:1.0:1789448219.039491:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448219.039496:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 11 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448219.039507:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 11 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448219.039525:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448219.039565:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+11:2350:x1876372295258112:12345-192.168.202.54@tcp:103: Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448219.039571:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789448219.039587:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448219.039593:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295258240:12345-192.168.202.54@tcp:103: 00010000:00010000:1.0:1789448219.039600:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448219.039604:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 10 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448219.039632:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 10 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448219.039642:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448219.039660:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295258240:12345-192.168.202.54@tcp:103: Request processed in 67us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448219.039666:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1789448219.040541:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789448219.040566:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.040579:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.040585:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.040590:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.040598:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.040604:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317300992 00000100:00100000:2.0:1789448219.040608:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317300992 00000100:00100000:2.0:1789448219.040627:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301120 00000100:00100000:2.0:1789448219.040628:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301120 00000100:00100000:2.0:1789448219.040633:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301248 00000100:00100000:2.0:1789448219.040643:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301248 00000100:00100000:2.0:1789448219.040650:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301376 00000100:00100000:2.0:1789448219.040651:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301376 00000100:00100000:2.0:1789448219.040656:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301504 00000100:00100000:2.0:1789448219.040657:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301504 00000100:00100000:2.0:1789448219.040662:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301632 00000100:00100000:2.0:1789448219.040664:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301632 00000100:00100000:2.0:1789448219.040668:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301760 00000100:00100000:2.0:1789448219.040669:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301760 00000100:00100000:2.0:1789448219.040675:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448219.040679:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:8427:x1876372317300992:12345-0@lo:104: 00010000:00010000:2.0:1789448219.040689:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.040734:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789448219.040738:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+9:8427:x1876372317300992:12345-0@lo:104: Request processed in 60us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.040742:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448219.040752:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448219.040756:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fa88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+8:8427:x1876372317301120:12345-0@lo:104: 00010000:00010000:2.0:1789448219.040761:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.040783:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789448219.040786:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fa88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+8:8427:x1876372317301120:12345-0@lo:104: Request processed in 30us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.040789:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448219.040809:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448219.040813:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:8427:x1876372317301248:12345-0@lo:104: 00010000:00010000:2.0:1789448219.040824:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.040841:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789448219.040844:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+7:8427:x1876372317301248:12345-0@lo:104: Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.040847:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448219.040854:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448219.040858:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:8427:x1876372317301376:12345-0@lo:104: 00010000:00010000:2.0:1789448219.040861:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.040988:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789448219.040995:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58200/0xe29566c2465f972c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb65 expref: 9 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.040996:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+6:8427:x1876372317301376:12345-0@lo:104: Request processed in 136us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.041012:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448219.041024:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300736:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448219.041029:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789448219.041041:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32200/0xe29566c2465f9725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb5e expref: 8 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448219.041077:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300864:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448219.041092:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317300992:0@lo:104: 00000100:00100000:0.0:1789448219.041099:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301120:0@lo:104: 00000100:00100000:0.0:1789448219.041105:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301248:0@lo:104: 00000100:00100000:0.0:1789448219.041112:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301376:0@lo:104: 00000100:00100000:2.0:1789448219.041134:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:8427:x1876372317301504:12345-0@lo:104: 00010000:00010000:2.0:1789448219.041142:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041249:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789448219.041254:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:8427:x1876372317301504:12345-0@lo:104: Request processed in 124us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.041260:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448219.041275:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448219.041280:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:8427:x1876372317301632:12345-0@lo:104: 00010000:00010000:2.0:1789448219.041294:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041399:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789448219.041405:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:8427:x1876372317301632:12345-0@lo:104: Request processed in 124us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.041410:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448219.041423:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448219.041429:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:8427:x1876372317301760:12345-0@lo:104: 00010000:00010000:2.0:1789448219.041437:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041463:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789448219.041466:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:8427:x1876372317301760:12345-0@lo:104: Request processed in 39us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.041471:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789448219.041493:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789448219.041500:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041507:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.041511:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041519:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.041525:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.041538:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.041578:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041586:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.041609:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041616:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f9710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448219.041619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317301888:0@lo:103: 00010000:00010000:2.0:1789448219.041632:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789448219.041636:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.041641:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.041644:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448219.041664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448219.041710:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317301888 00000100:00100000:3.0:1789448219.041716:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317301888 00010000:00010000:3.0:1789448219.041736:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448219.041759:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448219.041767:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317301888:12345-0@lo:103: 00010000:00010000:3.0:1789448219.041777:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448219.041782:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448219.041792:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448219.041805:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f9717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9710 expref: 19 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448219.041818:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448219.041848:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3306:x1876372317301888:12345-0@lo:103: Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448219.041856:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448219.041897:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317301888:0@lo:103: 00000100:00100000:0.0:1789448219.042016:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301504:0@lo:104: 00000100:00100000:0.0:1789448219.042025:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301632:0@lo:104: 00000100:00100000:0.0:1789448219.042032:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1876372317301760:0@lo:104: 00010000:00010000:0.0:1789448219.042168:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042205:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.042212:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.042309:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789448219.042309:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789448219.042571:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042578:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.042603:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042610:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2400/0xe29566c2465f96e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042620:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789448219.042624:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042630:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59a00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.042633:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042640:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.042646:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.042652:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.042670:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042676:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.042690:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae59a00/0xe29566c2465f96bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042703:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448219.042713:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042718:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523a00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.042721:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042727:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.042733:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.042738:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.042750:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042756:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.042761:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042766:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523a00/0xe29566c2465f96ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042775:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448219.042778:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042784:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1e00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.042786:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042802:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.042807:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.042812:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.042824:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042830:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.042835:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1e00/0xe29566c2465f9684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f968b expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042849:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448219.042852:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042857:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.042860:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042879:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.042885:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.042908:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.042923:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042929:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448219.042934:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042939:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1600/0xe29566c2465f965a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9661 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.042947:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448219.042949:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448219.042950:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448219.042964:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302016:0@lo:103: 00000100:00100000:2.0:1789448219.043003:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.043032:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302528:0@lo:103: 00000100:00100000:2.0:1789448219.043050:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.043068:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448219.043074:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302400:0@lo:103: 00000100:00100000:2.0:1789448219.043090:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.043111:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302144:0@lo:103: 00000100:00100000:2.0:1789448219.043132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.043283:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448219.043290:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302272:0@lo:103: 00000100:00100000:2.0:1789448219.043313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.043418:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302016 00000100:00100000:2.0:1789448219.043431:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302016 00010000:00010000:2.0:1789448219.043452:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 18 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.043467:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302528 00000100:00100000:2.0:1789448219.043470:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302528 00010000:00010000:2.0:1789448219.043481:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 19 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.043490:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302400 00000100:00100000:2.0:1789448219.043492:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302400 00010000:00010000:2.0:1789448219.043500:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 20 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.043507:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302144 00000100:00100000:2.0:1789448219.043509:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302144 00010000:00010000:2.0:1789448219.043516:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 21 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.043524:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302272 00000100:00100000:2.0:1789448219.043526:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302272 00010000:00010000:2.0:1789448219.043533:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 22 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.043544:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448219.043549:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+22:3307:x1876372317302016:12345-0@lo:103: 00010000:00010000:2.0:1789448219.043558:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.043561:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 22 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043570:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 22 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043594:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc3400/0xe29566c2465f96ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f96e6 expref: 22 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043607:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448219.043644:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+21:3307:x1876372317302016:12345-0@lo:103: Request processed in 94us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.043652:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448219.043668:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448219.043674:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3307:x1876372317302528:12345-0@lo:103: 00010000:00010000:2.0:1789448219.043682:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.043686:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 20 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043694:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 20 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043703:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523000/0xe29566c2465f9661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f965a expref: 20 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043711:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448219.043729:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317302528:12345-0@lo:103: Request processed in 55us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.043734:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448219.043746:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448219.043752:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3307:x1876372317302400:12345-0@lo:103: 00010000:00010000:2.0:1789448219.043759:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.043764:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043776:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043785:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f968b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9684 expref: 18 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043793:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448219.043815:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3307:x1876372317302400:12345-0@lo:103: Request processed in 64us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.043820:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448219.043832:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448219.043837:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3304:x1876372317302144:12345-0@lo:103: 00010000:00010000:2.0:1789448219.043844:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.043848:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 16 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043856:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 16 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043878:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae33400/0xe29566c2465f96c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f96bc expref: 16 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.043886:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448219.043975:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3304:x1876372317302144:12345-0@lo:103: Request processed in 137us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.043981:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448219.044014:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448219.044019:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3304:x1876372317302272:12345-0@lo:103: 00010000:00010000:2.0:1789448219.044032:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.044037:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.044044:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.044052:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f96b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f96ae expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.044060:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448219.044081:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3304:x1876372317302272:12345-0@lo:103: Request processed in 61us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.044087:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448219.044132:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302272:0@lo:103: 00000100:00100000:2.0:1789448219.044141:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302144:0@lo:103: 00000100:00100000:0.0:1789448219.044279:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302400:0@lo:103: 00000100:00100000:0.0:1789448219.044287:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302016:0@lo:103: 00000100:00100000:0.0:1789448219.044293:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317302528:0@lo:103: 00010000:00010000:1.0:1789448219.045003:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448219.045007:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448219.045009:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448219.045169:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045179:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448219.045182:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045190:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448219.045196:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448219.045214:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448219.045455:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045462:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789448219.045508:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302656:0@lo:103: 00000100:00100000:1.0:1789448219.045551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448219.045602:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045610:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae32400/0xe29566c2465f96ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f96d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045625:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448219.045626:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448219.045628:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448219.045640:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302656 00000100:00100000:2.0:1789448219.045645:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302656 00010000:00010000:2.0:1789448219.045665:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 13 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.045685:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448219.045691:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:3304:x1876372317302656:12345-0@lo:103: 00010000:00010000:2.0:1789448219.045699:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448219.045703:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 13 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045711:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 13 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045722:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c13a0a00/0xe29566c2465f96d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f96ca expref: 13 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045743:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045752:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045765:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045772:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045779:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045786:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045791:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448219.045794:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045801:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045822:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448219.045830:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448219.046013:0:8427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.046020:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448219.046026:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32c00/0xe29566c2465f9764 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448219.046940:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3304:x1876372317302656:12345-0@lo:103: Request processed in 1246us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.046958:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789448219.046973:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302656:0@lo:103: 00000100:00100000:0.0:1789448219.417640:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317302912:0@lo:400: 00000100:00100000:0.0:1789448219.417717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448219.417832:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448219.417846:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302784:0@lo:400: 00000100:00100000:1.0:1789448219.417895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448219.417933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302912 00000100:00100000:1.0:1789448219.417940:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302912 00000100:00100000:1.0:1789448219.417984:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789448219.417992:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317302912:12345-0@lo:400: 00000100:00100000:2.0:1789448219.418235:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317302784 00000100:00100000:2.0:1789448219.418239:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317302784 00000100:00100000:2.0:1789448219.418275:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789448219.418282:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3304:x1876372317302784:12345-0@lo:400: 00000100:00100000:2.0:1789448219.418329:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:3304:x1876372317302784:12345-0@lo:400: Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.418341:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789448219.418384:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317302784:0@lo:400: 00000100:00100000:2.0:1789448219.418424:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317303040:0@lo:400: 00000100:00100000:2.0:1789448219.418446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.418475:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303040 00000100:00100000:2.0:1789448219.418478:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303040 00000100:00100000:2.0:1789448219.418506:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448219.418511:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317303040:12345-0@lo:400: 00000100:00100000:2.0:1789448219.418538:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317303040:12345-0@lo:400: Request processed in 28us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.418544:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448219.418566:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317303040:0@lo:400: 00000100:00080000:2.0:1789448219.418586:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448219.419092:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317303296:0@lo:400: 00000100:00100000:3.0:1789448219.419124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448219.419141:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448219.419146:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317303168:0@lo:400: 00000100:00100000:3.0:1789448219.419165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448219.419187:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303168 00000100:00100000:3.0:1789448219.419191:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303168 00000100:00100000:3.0:1789448219.419235:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448219.419241:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317303168:12345-0@lo:400: 00000100:00100000:3.0:1789448219.419283:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317303168:12345-0@lo:400: Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448219.419289:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789448219.419307:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448219.419313:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448219.419328:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317303424:0@lo:400: 00000100:00100000:2.0:1789448219.419512:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303296 00000100:00100000:2.0:1789448219.419517:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303296 00000100:00100000:2.0:1789448219.419542:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789448219.419548:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317303296:12345-0@lo:400: 00000100:00100000:1.0:1789448219.419683:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317302912:12345-0@lo:400: Request processed in 1690us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448219.419690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789448219.419718:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448219.419785:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317303296:12345-0@lo:400: Request processed in 237us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.419802:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789448219.419849:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc5500 x1876372317303168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448219.419872:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317303168:0@lo:400: 00000100:00100000:2.0:1789448219.419882:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317303296:0@lo:400: 00000100:00100000:3.0:1789448219.420095:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.420177:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303424 00000100:00100000:2.0:1789448219.420181:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303424 00000100:00100000:2.0:1789448219.420242:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448219.420249:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317303424:12345-0@lo:400: 00000100:00100000:2.0:1789448219.420296:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317303424:12345-0@lo:400: Request processed in 48us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.420302:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789448219.420543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc7b80 x1876372317303424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448219.420553:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317303424:0@lo:400: 00000100:00080000:1.0:1789448219.420608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448219.420674:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317302912:0@lo:400: 00000100:00100000:2.0:1789448219.591780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448219.591838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448219.591894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448219.591928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448219.591957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258368 00000100:00100000:2.0:1789448219.591967:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258368 00000100:00100000:2.0:1789448219.592014:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:2.0:1789448219.592025:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:2351:x1876372295258368:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789448219.592091:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:2351:x1876372295258368:12345-192.168.202.54@tcp:400: Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.592098:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:2.0:1789448219.592133:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258752 00000100:00100000:2.0:1789448219.592137:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258752 00000100:00100000:2.0:1789448219.592184:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258624 00000100:00100000:2.0:1789448219.592187:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258624 00000100:00100000:2.0:1789448219.592203:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789448219.592209:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295258752:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789448219.592286:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295258752:12345-192.168.202.54@tcp:400: Request processed in 77us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.592292:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789448219.592304:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789448219.592310:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295258624:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789448219.592829:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295258624:12345-192.168.202.54@tcp:400: Request processed in 517us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.592836:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789448219.595264:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258496 00000100:00100000:1.0:1789448219.595280:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258496 00000100:00100000:1.0:1789448219.596072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789448219.596087:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295258496:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1789448219.596171:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295258496:12345-192.168.202.54@tcp:400: Request processed in 88us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448219.596177:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00080000:1.0:1789448219.596208:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448219.596214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448219.596479:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789448219.801686:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448219.931636:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448219.931665:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317303552:0@lo:13: 00000100:00100000:1.0:1789448219.931734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448219.931973:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303552 00000100:00100000:2.0:1789448219.931983:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303552 00000100:00100000:2.0:1789448219.932035:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448219.932044:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317303552:12345-0@lo:13: 00002000:00000024:2.0:1789448219.932080:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448219.932139:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317303552:12345-0@lo:13: Request processed in 96us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448219.932146:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789448219.932725:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb009f80 x1876372317303552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448219.932747:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317303552:0@lo:13: 00000100:00100000:1.0:1789448220.442120:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317303680:0@lo:13: 00000100:00100000:1.0:1789448220.442190:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448220.444026:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303680 00000100:00100000:2.0:1789448220.444041:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303680 00000100:00100000:2.0:1789448220.444109:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448220.444120:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317303680:12345-0@lo:13: 00002000:00000024:2.0:1789448220.444157:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448220.444384:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317303680:12345-0@lo:13: Request processed in 265us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.444406:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789448220.454089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b0a80 x1876372317303680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448220.454123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317303680:0@lo:13: 00010000:00010000:1.0:1789448220.825561:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789448220.956175:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789448220.956186:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9e7a74000 from 39 10000000:01000000:0.0:1789448220.956194:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789448220.956288:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.956303:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.956317:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448220.956351:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317303808:0@lo:101: 00000100:00100000:0.0:1789448220.956499:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448220.956585:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.956600:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303808 00000100:00100000:2.0:1789448220.956619:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303808 00000100:00100000:2.0:1789448220.956692:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789448220.956702:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+12:5831:x1876372317303808:12345-0@lo:101: 00010000:00010000:2.0:1789448220.956718:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448220.956741:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2400/0xe29566c2465f9772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f976b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.956772:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2400/0xe29566c2465f9772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f976b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.956783:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2400/0xe29566c2465f9772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f976b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.956793:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2400, rc 0) 00000100:00100000:2.0:1789448220.956881:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317303808:12345-0@lo:101: Request processed in 181us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.956887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789448220.957634:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317303808:0@lo:101: 00010000:00010000:3.0:1789448220.957673:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448220.957687:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448220.957775:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317303936:0@lo:501: 00000100:00100000:3.0:1789448220.957844:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.957891:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.961128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317303936 00000100:00100000:2.0:1789448220.961143:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317303936 00000100:00100000:2.0:1789448220.961210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789448220.961249:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317303936:12345-0@lo:501: 00000100:00100000:2.0:1789448220.961546:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317303936:12345-0@lo:501: Request processed in 298us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.961554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789448220.961635:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317303936:0@lo:501: 00000100:00100000:3.0:1789448220.961719:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304064:0@lo:503: 00000100:00100000:3.0:1789448220.961797:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.961859:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.962073:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304064 00000100:00100000:0.0:1789448220.962081:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304064 00000100:00100000:0.0:1789448220.962142:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789448220.962152:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317304064:12345-0@lo:503: 00000100:00100000:0.0:1789448220.962608:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317304064:12345-0@lo:503: Request processed in 456us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.962617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789448220.963989:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304064:0@lo:503: 00000100:00100000:3.0:1789448220.965925:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8445:1876372317304192:0@lo:502: 00000100:00100000:3.0:1789448220.966047:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.966103:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.966255:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304192 00000100:00100000:2.0:1789448220.966265:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304192 00000100:00100000:2.0:1789448220.966339:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789448220.966350:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:8445:x1876372317304192:12345-0@lo:502: 00000100:00100000:2.0:1789448220.966682:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:8445:x1876372317304192:12345-0@lo:502: Request processed in 333us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.966691:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789448220.967183:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8445:1876372317304192:0@lo:502: 00000100:00100000:3.0:1789448220.967292:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8445:1876372317304320:0@lo:502: 00000100:00100000:3.0:1789448220.967335:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.967366:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.967420:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304320 00000100:00100000:0.0:1789448220.967426:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304320 00000100:00100000:0.0:1789448220.967465:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789448220.967475:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:8445:x1876372317304320:12345-0@lo:502: 00000100:00100000:0.0:1789448220.967644:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:8445:x1876372317304320:12345-0@lo:502: Request processed in 171us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.967649:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789448220.968194:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8445:1876372317304320:0@lo:502: 00000040:00080000:3.0:1789448220.968243:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789448220.968625:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789448220.968651:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448220.968675:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.968689:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448220.968700:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789448220.968703:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789448220.968706:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789448220.968744:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.968753:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.968764:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448220.968782:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304448:0@lo:101: 00000100:00100000:0.0:1789448220.968829:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448220.968879:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.969095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304448 00000100:00100000:2.0:1789448220.969104:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304448 00000100:00100000:2.0:1789448220.969150:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789448220.969159:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+13:5831:x1876372317304448:12345-0@lo:101: 00010000:00010000:2.0:1789448220.969173:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448220.969190:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc3000/0xe29566c2465f9780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9779 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.969256:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc3000/0xe29566c2465f9780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9779 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.969271:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc3000/0xe29566c2465f9780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9779 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.969282:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3000, rc 0) 00000100:00100000:2.0:1789448220.969325:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317304448:12345-0@lo:101: Request processed in 167us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.969332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789448220.969456:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304448:0@lo:101: 00010000:00010000:3.0:1789448220.969472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448220.969482:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448220.969538:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304576:0@lo:501: 00000100:00100000:3.0:1789448220.969584:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.969606:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448220.969873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304576 00000100:00100000:1.0:1789448220.969878:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304576 00000100:00100000:1.0:1789448220.969921:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789448220.969929:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317304576:12345-0@lo:501: 00000100:00100000:1.0:1789448220.970293:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317304576:12345-0@lo:501: Request processed in 364us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448220.970300:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789448220.970500:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304576:0@lo:501: 00000100:00100000:3.0:1789448220.970525:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304704:0@lo:503: 00000100:00100000:3.0:1789448220.970559:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.970579:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.970672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304704 00000100:00100000:0.0:1789448220.970677:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304704 00000100:00100000:0.0:1789448220.970708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789448220.970716:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317304704:12345-0@lo:503: 00000100:00100000:0.0:1789448220.971028:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317304704:12345-0@lo:503: Request processed in 312us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.971036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789448220.971193:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317304704:0@lo:503: 00000100:00100000:3.0:1789448220.971784:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8446:1876372317304832:0@lo:502: 00000100:00100000:3.0:1789448220.971832:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.972035:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448220.972072:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304832 00000100:00100000:1.0:1789448220.972078:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304832 00000100:00100000:1.0:1789448220.972119:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789448220.972127:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:8446:x1876372317304832:12345-0@lo:502: 00000100:00100000:1.0:1789448220.975200:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:8446:x1876372317304832:12345-0@lo:502: Request processed in 3054us (3348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448220.975234:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789448220.975914:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8446:1876372317304832:0@lo:502: 00000020:01000000:3.0:1789448220.976058:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448220.976071:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448220.976074:0:8446:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789448220.976080:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789448220.976131:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8446:1876372317304960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448220.976210:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.976308:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.976347:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317304960 00000100:00100000:2.0:1789448220.976356:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317304960 00000100:00100000:2.0:1789448220.976499:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789448220.976510:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:8446:x1876372317304960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448220.976765:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:8446:x1876372317304960:12345-0@lo:502:llog_process_th.0 Request processed in 255us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.976779:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789448220.976866:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8446:1876372317304960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448220.976887:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448220.976892:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448220.976894:0:8446:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789448220.976898:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789448220.977265:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789448220.977289:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789448220.977302:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.977316:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448220.977328:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789448220.977331:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c336e800 from 39 10000000:01000000:1.0:1789448220.977335:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789448220.977371:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.977380:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.977392:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448220.977438:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.977480:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448220.977728:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.977837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305088 00000100:00100000:0.0:1789448220.977844:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305088 00000100:00100000:0.0:1789448220.977887:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789448220.977897:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:5831:x1876372317305088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448220.977913:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448220.977932:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32400/0xe29566c2465f978e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9787 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.977971:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32400/0xe29566c2465f978e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9787 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.977983:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32400/0xe29566c2465f978e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9787 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.977993:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32400, rc 0) 00000100:00100000:0.0:1789448220.978042:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.978049:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789448220.978188:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448220.978205:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.978243:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448220.978308:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.978335:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448220.978358:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.978416:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305216 00000100:00100000:0.0:1789448220.978421:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305216 00000100:00100000:0.0:1789448220.978438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789448220.978444:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448220.978925:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 479us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.978933:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789448220.979638:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.979692:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.979747:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448220.979789:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448220.979860:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305344 00000100:00100000:2.0:1789448220.979866:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305344 00000100:00100000:2.0:1789448220.979912:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789448220.979921:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448220.980474:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 553us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.980483:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789448220.980565:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448220.981131:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8447:1876372317305472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448220.981182:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448220.981254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305472 00000100:00100000:2.0:1789448220.981257:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448220.981260:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305472 00000100:00100000:3.0:1789448220.981290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789448220.981307:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:8447:x1876372317305472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448220.981568:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:8447:x1876372317305472:12345-0@lo:502:llog_process_th.0 Request processed in 262us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.981589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789448220.981605:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8447:1876372317305472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448220.981657:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8447:1876372317305600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448220.981690:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448220.981712:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.981740:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305600 00000100:00100000:0.0:1789448220.981746:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305600 00000100:00100000:0.0:1789448220.981779:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789448220.981788:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:8447:x1876372317305600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448220.981978:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:8447:x1876372317305600:12345-0@lo:502:llog_process_th.0 Request processed in 192us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.981986:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789448220.983705:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8447:1876372317305600:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789448220.983767:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789448220.986687:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789448220.986739:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789448220.986756:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.986772:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448220.986805:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789448220.986809:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789448220.986813:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789448220.986875:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.986884:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.986898:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448220.986931:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.987021:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448220.987081:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.989572:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305728 00000100:00100000:0.0:1789448220.989592:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305728 00000100:00100000:0.0:1789448220.989676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789448220.989688:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:5831:x1876372317305728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448220.989711:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448220.989735:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f979c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9795 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.989771:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f979c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9795 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.989784:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f979c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9795 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.989795:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32a00, rc 0) 00000100:00100000:0.0:1789448220.989902:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317305728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.989910:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789448220.992988:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448220.993027:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448220.993043:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448220.993151:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448220.993540:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448220.993693:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448220.998146:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305856 00000100:00100000:0.0:1789448220.998166:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305856 00000100:00100000:0.0:1789448220.998261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789448220.998274:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317305856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448220.999114:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317305856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 839us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.999126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789448221.006207:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.006354:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.006604:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448221.006658:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448221.006938:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317305984 00000100:00100000:0.0:1789448221.006948:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317305984 00000100:00100000:0.0:1789448221.007014:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789448221.007029:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317305984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.007383:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317305984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 357us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448221.007393:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789448221.007499:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317305984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.008328:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8448:1876372317306112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.008402:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.008442:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448221.008828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306112 00000100:00100000:0.0:1789448221.008836:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306112 00000100:00100000:0.0:1789448221.008896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789448221.008907:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:8448:x1876372317306112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448221.009135:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:8448:x1876372317306112:12345-0@lo:502:llog_process_th.0 Request processed in 230us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448221.009144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789448221.009170:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8448:1876372317306112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448221.009242:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448221.009253:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448221.009257:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789448221.009262:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789448221.009290:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8448:1876372317306240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448221.009331:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448221.009367:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.009390:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306240 00000100:00100000:1.0:1789448221.009396:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306240 00000100:00100000:1.0:1789448221.009432:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789448221.009441:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:8448:x1876372317306240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448221.009587:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:8448:x1876372317306240:12345-0@lo:502:llog_process_th.0 Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.009593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789448221.009742:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8448:1876372317306240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448221.009777:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448221.009782:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448221.009784:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789448221.009788:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789448221.010036:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789448221.010062:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789448221.010073:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.010087:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448221.010098:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789448221.010101:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9c6cee800 from 39 10000000:01000000:1.0:1789448221.010104:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789448221.010133:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.010142:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.010154:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448221.010174:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.010245:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448221.010265:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448221.010478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306368 00000100:00100000:3.0:1789448221.010484:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306368 00000100:00100000:3.0:1789448221.010512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789448221.010520:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317306368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448221.010532:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448221.010547:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f97aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97a3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.010584:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f97aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97a3 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.010608:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f97aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97a3 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.010619:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1522e00, rc 0) 00000100:00100000:3.0:1789448221.010654:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317306368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448221.010661:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789448221.010705:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448221.010719:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.010729:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448221.010982:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448221.011009:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448221.011045:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.011058:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306496 00000100:00100000:1.0:1789448221.011063:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306496 00000100:00100000:1.0:1789448221.011395:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789448221.011402:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317306496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.011767:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317306496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.011777:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789448221.011836:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.011905:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.011960:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448221.013728:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448221.014084:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306624 00000100:00100000:2.0:1789448221.014096:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306624 00000100:00100000:2.0:1789448221.014158:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789448221.014169:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317306624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.014898:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317306624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 727us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448221.014909:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789448221.019932:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317306624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.021181:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8449:1876372317306752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448221.021302:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448221.021355:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789448221.022380:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306752 00000100:00100000:3.0:1789448221.022394:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306752 00000100:00100000:3.0:1789448221.022454:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789448221.022466:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8449:x1876372317306752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448221.022805:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8449:x1876372317306752:12345-0@lo:502:llog_process_th.0 Request processed in 340us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448221.022813:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789448221.022875:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8449:1876372317306752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.022972:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8449:1876372317306880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.023018:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.023059:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448221.024659:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317306880 00000100:00100000:3.0:1789448221.024672:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317306880 00000100:00100000:3.0:1789448221.024749:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789448221.024759:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8449:x1876372317306880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448221.025194:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8449:x1876372317306880:12345-0@lo:502:llog_process_th.0 Request processed in 436us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448221.025203:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789448221.025262:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8449:1876372317306880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789448221.025308:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789448221.025480:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789448221.025506:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789448221.025520:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.025533:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448221.025544:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789448221.025548:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789448221.025551:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789448221.025587:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.025597:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.025606:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448221.025629:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448221.025667:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448221.027576:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.028032:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307008 00000100:00100000:1.0:1789448221.028043:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307008 00000100:00100000:1.0:1789448221.028128:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789448221.028139:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317307008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448221.028160:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448221.028182:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae59000/0xe29566c2465f97b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97b1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.028428:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59000/0xe29566c2465f97b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97b1 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.028443:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae59000/0xe29566c2465f97b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97b1 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.028454:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59000, rc 0) 00000100:00100000:1.0:1789448221.028591:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 453us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.028613:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789448221.029075:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448221.029105:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448221.029117:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448221.029423:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.035453:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.035812:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448221.036304:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307136 00000100:00100000:0.0:1789448221.036317:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307136 00000100:00100000:0.0:1789448221.036388:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789448221.036400:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.036789:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448221.036799:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789448221.037037:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.037106:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.037158:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.038089:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.041782:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307264 00000100:00100000:1.0:1789448221.041803:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307264 00000100:00100000:1.0:1789448221.041889:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789448221.041902:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.042629:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.042736:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 837us (5576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.042745:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789448221.043374:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8450:1876372317307392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.043434:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448221.043664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307392 00000100:00100000:1.0:1789448221.043671:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307392 00000100:00100000:1.0:1789448221.043713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789448221.043721:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8450:x1876372317307392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.043893:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.044705:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8450:x1876372317307392:12345-0@lo:502:llog_process_th.0 Request processed in 982us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.044714:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789448221.044797:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8450:1876372317307392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448221.044829:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448221.044840:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448221.044842:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789448221.044868:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789448221.044895:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8450:1876372317307520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448221.044931:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.044995:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.045026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307520 00000100:00100000:1.0:1789448221.045030:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307520 00000100:00100000:1.0:1789448221.045068:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789448221.045075:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8450:x1876372317307520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448221.045545:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8450:x1876372317307520:12345-0@lo:502:llog_process_th.0 Request processed in 468us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.045553:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789448221.045616:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8450:1876372317307520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448221.045634:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448221.045638:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448221.045640:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789448221.045643:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789448221.045782:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789448221.045809:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789448221.045822:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.045836:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448221.045858:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789448221.045862:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97d9eaf63380 from 1 10000000:01000000:0.0:1789448221.045866:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789448221.045897:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.045907:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.045917:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448221.045934:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448221.045970:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448221.046019:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.046078:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307648 00000100:00100000:1.0:1789448221.046084:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307648 00000100:00100000:1.0:1789448221.046120:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789448221.046128:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317307648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448221.046146:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448221.046162:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae59600/0xe29566c2465f97c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97bf expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.046188:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59600/0xe29566c2465f97c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97bf expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.046208:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae59600/0xe29566c2465f97c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97bf expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448221.046235:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59600, rc 0) 00000100:00100000:1.0:1789448221.046272:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317307648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448221.046279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789448221.048138:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448221.048171:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448221.048186:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448221.048312:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448221.048374:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448221.048423:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448221.048888:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317307776 00000100:00100000:1.0:1789448221.048897:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317307776 00000100:00100000:1.0:1789448221.048955:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789448221.048965:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317307776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448221.049336:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317307776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (961us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789448221.049345:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789448221.049416:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317307776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789448221.049449:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789448221.049458:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448221.049468:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448221.849529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448222.720158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448222.723012:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295258880 00000100:00100000:0.0:1789448222.723038:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295258880 00000100:00100000:0.0:1789448222.723246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:0.0:1789448222.723260:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+8:5591:x1876372295258880:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1789448222.723297:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448222.723326:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32200/0xe29566c2465f97cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ebc7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.723364:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32200/0xe29566c2465f97cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc7 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.723377:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32200/0xe29566c2465f97cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc7 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.723387:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32200, rc 0) 00000100:00100000:0.0:1789448222.723483:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295258880:12345-192.168.202.54@tcp:101: Request processed in 227us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448222.723490:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:3.0:1789448222.746984:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448222.747526:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259008 00000100:00100000:1.0:1789448222.747539:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259008 00000100:00100000:1.0:1789448222.747608:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:1.0:1789448222.747619:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295259008:12345-192.168.202.54@tcp:501: 00000100:00100000:1.0:1789448222.748039:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295259008:12345-192.168.202.54@tcp:501: Request processed in 421us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448222.748059:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:2.0:1789448222.774484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448222.774608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259136 00000100:00100000:0.0:1789448222.774623:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259136 00000100:00100000:0.0:1789448222.774697:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:0.0:1789448222.774709:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295259136:12345-192.168.202.54@tcp:503: 00000100:00100000:0.0:1789448222.775020:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295259136:12345-192.168.202.54@tcp:503: Request processed in 312us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448222.775028:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:2.0:1789448222.795199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448222.795714:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259264 00000100:00100000:0.0:1789448222.795729:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259264 00000100:00100000:0.0:1789448222.796018:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:0.0:1789448222.796031:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+9:6077:x1876372295259264:12345-192.168.202.54@tcp:502: 00000100:00100000:0.0:1789448222.797177:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+9:6077:x1876372295259264:12345-192.168.202.54@tcp:502: Request processed in 1142us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448222.797191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:3.0:1789448222.808182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448222.808408:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259392 00000100:00100000:1.0:1789448222.808423:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259392 00000100:00100000:1.0:1789448222.808494:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:1.0:1789448222.808506:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:6077:x1876372295259392:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448222.808911:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:6077:x1876372295259392:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 406us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448222.808922:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:2.0:1789448222.815714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448222.816174:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259520 00000100:00100000:0.0:1789448222.816188:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259520 00000100:00100000:0.0:1789448222.816296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:0.0:1789448222.816309:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295259520:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448222.816331:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448222.816356:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33e00/0xe29566c2465f97d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ebce expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.816396:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33e00/0xe29566c2465f97d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebce expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.816410:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33e00/0xe29566c2465f97d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebce expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448222.816420:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33e00, rc 0) 00000100:00100000:0.0:1789448222.816499:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295259520:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 192us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448222.816507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1789448222.823348:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448222.823901:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259648 00000100:00100000:3.0:1789448222.823916:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259648 00000100:00100000:3.0:1789448222.823993:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:3.0:1789448222.824005:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295259648:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448222.824663:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295259648:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 657us (1327us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448222.824675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00010000:00010000:2.0:1789448222.877034:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448223.897588:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789448224.469770:0:8490:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd452784a0 20000000:00000080:2.0:1789448224.469796:0:8490:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d9c6095800 uarg=0000000000000000 20000000:01000000:2.0:1789448224.470070:0:8490:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789448224.470078:0:8490:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789448224.470084:0:8490:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789448224.471364:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789448224.471538:0:8490:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789448224.476046:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789448224.476125:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789448224.476185:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789448224.476210:0:8490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789448224.476457:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476484:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9549 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476493:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f95ab expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476500:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9676 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476512:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476542:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476603:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476624:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 9 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.476645:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317307904:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448224.476800:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476809:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 18 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.476831:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308032:0@lo:104: 00000100:00100000:1.0:1789448224.476889:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448224.476950:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.476958:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 18 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.476968:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308160:0@lo:104: 00000100:00100000:1.0:1789448224.476995:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448224.477015:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.477033:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.477042:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308288:0@lo:104: 00000100:00100000:1.0:1789448224.477062:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448224.477582:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789448224.477607:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448224.477622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308032 00000100:00100000:2.0:1789448224.477632:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308032 00000100:00100000:2.0:1789448224.477680:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308160 00000100:00100000:2.0:1789448224.477682:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308160 00000100:00100000:2.0:1789448224.477691:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308288 00000100:00100000:2.0:1789448224.477693:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308288 00000100:00100000:2.0:1789448224.477705:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448224.477716:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:8490:x1876372317308032:12345-0@lo:104: 00010000:00010000:2.0:1789448224.477732:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.477801:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789448224.477807:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:8490:x1876372317308032:12345-0@lo:104: Request processed in 94us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.477834:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448224.477865:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448224.477871:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d8c1a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:8490:x1876372317308160:12345-0@lo:104: 00010000:00010000:2.0:1789448224.477878:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.477915:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789448224.477920:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d8c1a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:8490:x1876372317308160:12345-0@lo:104: Request processed in 50us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.477926:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448224.477962:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448224.477968:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:8490:x1876372317308288:12345-0@lo:104: 00010000:00010000:2.0:1789448224.477977:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478008:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789448224.478013:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:8490:x1876372317308288:12345-0@lo:104: Request processed in 46us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.478018:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789448224.478041:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448224.478048:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478057:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448224.478061:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478083:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448224.478091:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448224.478098:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789448224.478136:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478143:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448224.478167:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478175:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523800/0xe29566c2465f9676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f967d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478192:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448224.478195:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478201:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448224.478204:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478211:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448224.478243:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448224.478255:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789448224.478270:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478276:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448224.478295:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478303:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f95ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f95b2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478314:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448224.478318:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478324:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448224.478326:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478333:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448224.478340:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448224.478345:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789448224.478358:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478364:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448224.478378:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478384:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c0031800/0xe29566c2465f9549 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9550 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478400:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448224.478402:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448224.478404:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448224.478412:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448224.478436:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317308416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448224.478477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448224.478528:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317308544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448224.478551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448224.478568:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448224.478572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317308672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448224.478589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448224.478617:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308416 00000100:00100000:2.0:1789448224.478624:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308416 00010000:00010000:2.0:1789448224.478644:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 19 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448224.478665:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308544 00000100:00100000:2.0:1789448224.478668:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308544 00010000:00010000:2.0:1789448224.478676:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 20 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448224.478684:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308672 00000100:00100000:2.0:1789448224.478686:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308672 00010000:00010000:2.0:1789448224.478693:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 21 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448224.478714:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448224.478719:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+21:3305:x1876372317308416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448224.478731:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448224.478736:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 21 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478745:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 21 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478762:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448224.478788:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+21:3305:x1876372317308416:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.478793:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448224.478805:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448224.478810:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3306:x1876372317308544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448224.478840:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448224.478844:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 20 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478851:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 20 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478860:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448224.478881:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3306:x1876372317308544:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.478887:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448224.478897:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448224.478910:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317308672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448224.478918:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448224.478922:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478929:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448224.478938:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448224.478956:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317308672:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448224.478961:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448224.479009:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317308672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448224.479016:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317308544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448224.479042:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317308416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448224.480000:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448224.480597:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c13a1800/0xe29566c2465f967d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9676 expref: 18 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.480633:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308032:0@lo:104: 00010000:00010000:1.0:1789448224.480645:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c13a0400/0xe29566c2465f95b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f95ab expref: 17 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.480657:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308160:0@lo:104: 00010000:00010000:1.0:1789448224.480665:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59800/0xe29566c2465f9550 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9549 expref: 16 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.480673:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317308288:0@lo:104: 00000100:00100000:2.0:1789448224.483644:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448224.483878:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259776 00000100:00100000:0.0:1789448224.483890:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259776 00010000:00010000:0.0:1789448224.483944:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448224.484030:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1789448224.484043:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295259776:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448224.484065:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448224.484072:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484085:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484113:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484123:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484145:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484152:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484159:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484166:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484172:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448224.484178:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484192:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484202:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448224.484213:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448224.484329:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295259776:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 288us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448224.484337:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:1.0:1789448224.486135:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59e00/0xe29566c2465f973a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb96 expref: 9 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448224.486164:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876372317307904:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448224.486208:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.486424:0:8490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.486433:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448224.486460:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f97db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448224.538563:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317309184:0@lo:400:kworker.0 00000100:00100000:3.0:1789448224.538663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448224.538726:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448224.538732:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317309056:0@lo:400:kworker.0 00000100:00100000:3.0:1789448224.538761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448224.538799:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309056 00000100:00100000:3.0:1789448224.538809:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309056 00000100:00100000:1.0:1789448224.538932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309184 00000100:00100000:1.0:1789448224.538938:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309184 00000100:00100000:3.0:1789448224.539020:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448224.539032:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317309056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448224.539097:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317309056:12345-0@lo:400:kworker.0 Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448224.539125:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789448224.539198:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6680 x1876372317309056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448224.539237:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317309056:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.540628:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317308928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.540710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448224.540760:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789448224.540768:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317308800:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.540794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448224.540827:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317309312:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.540867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448224.540920:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308928 00000100:00100000:0.0:1789448224.540928:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308928 00000100:00100000:3.0:1789448224.540998:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309312 00000100:00100000:3.0:1789448224.541004:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309312 00000100:00100000:1.0:1789448224.552557:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317308800 00000100:00100000:1.0:1789448224.552578:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317308800 00000100:00100000:1.0:1789448224.552615:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789448224.552629:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317309184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448224.552781:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317309184:12345-0@lo:400:kworker.0 Request processed in 156us (14118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448224.552789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789448224.552809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789448224.552828:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317308800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448224.552869:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317308800:12345-0@lo:400:kworker.0 Request processed in 55us (12075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448224.552876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789448224.552906:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448224.553006:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448224.553011:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448224.553309:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317308800:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.553504:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448224.553515:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317308928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.553567:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317308928:12345-0@lo:400:kworker.0 Request processed in 54us (12856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448224.553574:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448224.553696:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317308928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.555059:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317309184:0@lo:400:kworker.0 00000100:00100000:3.0:1789448224.555797:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448224.555811:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317309312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448224.556703:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317309312:12345-0@lo:400:kworker.0 Request processed in 889us (15829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448224.556714:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789448224.558714:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc7b80 x1876372317309312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448224.558757:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317309312:0@lo:400:kworker.0 00000100:00100000:0.0:1789448224.709909:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448224.709961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448224.710001:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448224.710192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295259904 00000100:00100000:1.0:1789448224.710205:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295259904 00000100:00100000:1.0:1789448224.710321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789448224.710333:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295259904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448224.710458:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295259904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 125us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448224.710467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789448224.711047:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260160 00000100:00100000:3.0:1789448224.711056:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260160 00000100:00100000:3.0:1789448224.711108:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260032 00000100:00100000:3.0:1789448224.711111:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260032 00000100:00100000:3.0:1789448224.711134:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1789448224.711142:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295260160:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448224.711192:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295260160:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 51us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448224.711200:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1789448224.711239:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1789448224.711247:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295260032:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448224.711274:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295260032:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448224.711281:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00080000:0.0:1789448224.711752:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448224.711758:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448224.711761:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789448224.925250:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448225.049946:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317309440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448225.050065:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.050329:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309440 00000100:00100000:1.0:1789448225.050340:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309440 00000100:00100000:1.0:1789448225.050405:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789448225.050417:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317309440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448225.050463:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448225.050761:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317309440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 346us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448225.050769:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789448225.054604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb008e00 x1876372317309440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448225.054642:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317309440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448225.564300:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448225.564327:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317309568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448225.564400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.565258:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309568 00000100:00100000:1.0:1789448225.565277:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309568 00000100:00100000:1.0:1789448225.565358:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789448225.565371:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317309568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448225.565424:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448225.565531:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317309568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448225.565540:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789448225.565594:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6680 x1876372317309568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448225.565621:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317309568:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789448225.763150:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448225.763157:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9e7a74000 from 4 10000000:01000000:3.0:1789448225.763162:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448225.763205:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763240:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763251:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.763276:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.763342:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.763390:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.763413:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309696 00000100:00100000:3.0:1789448225.763420:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309696 00000100:00100000:3.0:1789448225.763466:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789448225.763476:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317309696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.763489:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448225.763501:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763536:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763547:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763556:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523e00, rc 0) 00000100:00100000:3.0:1789448225.763595:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317309696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.763603:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789448225.763651:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.763665:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.763675:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.763726:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.763751:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.763767:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.763779:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309824 00000100:00100000:3.0:1789448225.763782:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309824 00000100:00100000:3.0:1789448225.763815:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789448225.763822:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317309824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.765279:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317309824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1450us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.765305:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789448225.765336:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448225.765417:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448225.765504:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448225.765679:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.766662:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317309952 00000100:00100000:3.0:1789448225.766676:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317309952 00000100:00100000:3.0:1789448225.766729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789448225.766740:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317309952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.766971:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317309952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.766979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789448225.767074:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317309952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448225.779356:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8551:1876372317310080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448225.779481:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448225.779534:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.788068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310080 00000100:00100000:3.0:1789448225.788088:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310080 00000100:00100000:3.0:1789448225.788164:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789448225.788175:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8551:x1876372317310080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448225.788543:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8551:x1876372317310080:12345-0@lo:502:llog_process_th.0 Request processed in 368us (9061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.788551:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789448225.789154:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8551:1876372317310080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789448225.789209:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448225.789260:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448225.789264:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789448225.789274:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9e7a74000 00000020:00000080:0.0:1789448225.789278:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789448225.789393:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8551:1876372317310208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448225.789454:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448225.789505:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c6d52900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.794516:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310208 00000100:00100000:3.0:1789448225.794540:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310208 00000100:00100000:3.0:1789448225.794672:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789448225.794686:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8551:x1876372317310208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448225.795105:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:8551:x1876372317310208:12345-0@lo:502:llog_process_th.0 Request processed in 421us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.795114:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789448225.795482:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8551:1876372317310208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789448225.795528:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448225.795538:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448225.795541:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789448225.795547:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789448225.799160:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789448225.799205:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448225.799251:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.799282:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448225.799295:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448225.799298:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c336e800 from 4 10000000:01000000:3.0:1789448225.799301:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448225.799351:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.799359:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.799372:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.799404:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.799493:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.799542:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c77636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.799582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310336 00000100:00100000:3.0:1789448225.799591:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310336 00000100:00100000:3.0:1789448225.799646:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789448225.799657:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317310336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.799675:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448225.799690:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97f0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.799717:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.800820:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.800952:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523a00, rc 0) 00000100:00100000:3.0:1789448225.801031:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1375us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.801041:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789448225.801123:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.801144:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.801155:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.801256:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.801290:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.801311:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c77636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.801329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310464 00000100:00100000:3.0:1789448225.801336:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310464 00000100:00100000:3.0:1789448225.801370:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789448225.801378:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.801673:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.801681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789448225.801712:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.801751:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.801793:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.801822:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c77636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.801847:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310592 00000100:00100000:3.0:1789448225.801851:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310592 00000100:00100000:3.0:1789448225.801873:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789448225.801880:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.803356:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1466us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.803370:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789448225.803469:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448225.815203:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8554:1876372317310720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448225.815341:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.815403:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.819351:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310720 00000100:00100000:3.0:1789448225.819376:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310720 00000100:00100000:3.0:1789448225.819459:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789448225.819476:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8554:x1876372317310720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448225.822187:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8554:x1876372317310720:12345-0@lo:502:llog_process_th.0 Request processed in 2706us (6834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.822205:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789448225.823134:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8554:1876372317310720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789448225.823193:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448225.823208:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448225.823239:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789448225.823250:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9c336e800 00000020:00000080:1.0:1789448225.823252:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789448225.823791:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8554:1876372317310848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448225.826540:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.826612:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.828080:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310848 00000100:00100000:3.0:1789448225.828096:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310848 00000100:00100000:3.0:1789448225.828185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789448225.828198:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8554:x1876372317310848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448225.828567:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:8554:x1876372317310848:12345-0@lo:502:llog_process_th.0 Request processed in 370us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.828577:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789448225.830998:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8554:1876372317310848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789448225.831059:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448225.831071:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448225.831074:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789448225.831080:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789448225.832341:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789448225.832377:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448225.832391:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.832406:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448225.832419:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448225.832423:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c6cee800 from 4 10000000:01000000:3.0:1789448225.832426:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448225.832473:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.832482:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.832495:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.832527:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.832612:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.832657:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5772e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.835180:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317310976 00000100:00100000:3.0:1789448225.835197:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317310976 00000100:00100000:3.0:1789448225.835284:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789448225.835297:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317310976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.835320:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448225.835344:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f97fe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.835393:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f97fe expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.835405:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97fe expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.835415:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c1523800, rc 0) 00000100:00100000:3.0:1789448225.835502:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317310976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.835509:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789448225.835577:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317310976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448225.835598:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448225.835609:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448225.835690:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317311104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.835726:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448225.835759:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5772e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.835773:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311104 00000100:00100000:3.0:1789448225.835777:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311104 00000100:00100000:3.0:1789448225.835800:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789448225.835819:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317311104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.844163:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317311104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 8329us (8420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.844195:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789448225.844529:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317311104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448225.844605:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317311232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448225.844676:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.844715:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.845003:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311232 00000100:00100000:3.0:1789448225.845014:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311232 00000100:00100000:3.0:1789448225.845073:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789448225.845083:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317311232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448225.845321:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317311232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.845329:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789448225.845447:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317311232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448225.848591:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8556:1876372317311360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448225.849439:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448225.849489:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448225.851363:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311360 00000100:00100000:3.0:1789448225.851381:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311360 00000100:00100000:3.0:1789448225.851451:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789448225.851463:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:8556:x1876372317311360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448225.854078:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:8556:x1876372317311360:12345-0@lo:502:llog_process_th.0 Request processed in 2606us (4630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448225.854100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789448225.855556:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8556:1876372317311360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448225.855873:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448225.855883:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448225.855886:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789448225.855898:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9c6cee800 00000020:00000080:2.0:1789448225.855901:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789448225.856056:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8556:1876372317311488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448225.856124:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448225.856167:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eaf50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448225.856610:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311488 00000100:00100000:1.0:1789448225.856627:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311488 00000100:00100000:1.0:1789448225.856693:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789448225.856705:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:8556:x1876372317311488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448225.857968:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:8556:x1876372317311488:12345-0@lo:502:llog_process_th.0 Request processed in 1260us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448225.857982:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789448225.862861:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:8556:1876372317311488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448225.862909:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448225.862917:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448225.862920:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789448225.862925:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789448225.863068:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789448225.863089:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448225.863098:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448225.863110:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448225.952796:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448226.433767:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448226.434441:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260288 00000100:00100000:2.0:1789448226.434459:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260288 00000100:00100000:2.0:1789448226.434534:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:2.0:1789448226.434624:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+9:5591:x1876372295260288:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448226.434651:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448226.434680:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ebd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448226.434722:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448226.434760:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448226.434773:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2200, rc 0) 00000100:00100000:2.0:1789448226.436434:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295260288:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 1800us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448226.436448:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:0.0:1789448226.454741:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448226.454900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260416 00000100:00100000:1.0:1789448226.454914:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260416 00000100:00100000:1.0:1789448226.454992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:1.0:1789448226.455012:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295260416:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448226.455408:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295260416:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 404us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448226.455417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:1.0:1789448226.460264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448226.460397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260544 00000100:00100000:0.0:1789448226.460413:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260544 00000100:00100000:0.0:1789448226.460481:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:0.0:1789448226.460494:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295260544:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448226.460817:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:5591:x1876372295260544:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 324us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448226.460827:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:1.0:1789448226.471040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448226.471886:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260672 00000100:00100000:0.0:1789448226.471900:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260672 00000100:00100000:0.0:1789448226.471983:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:0.0:1789448226.471995:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:6141:x1876372295260672:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448226.472324:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:6141:x1876372295260672:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 330us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448226.472333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:3.0:1789448226.481863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448226.484950:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260800 00000100:00100000:1.0:1789448226.484971:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260800 00000100:00100000:1.0:1789448226.485075:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:1.0:1789448226.485364:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:6141:x1876372295260800:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448226.485715:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:6141:x1876372295260800:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 627us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448226.485726:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00010000:00010000:0.0:1789448226.969341:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448227.993382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448229.026109:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448229.665099:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317311744:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448229.665259:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317312256:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665283:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448229.665314:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448229.665319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317311872:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448229.665370:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311744 00000100:00100000:1.0:1789448229.665384:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311744 00000100:00100000:1.0:1789448229.665424:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311872 00000100:00100000:1.0:1789448229.665427:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311872 00000100:00100000:1.0:1789448229.665452:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448229.665459:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317311744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665506:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317311744:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.665513:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448229.665528:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789448229.665534:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317311872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665557:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317311872:12345-0@lo:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.665563:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789448229.665578:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312256 00000100:00100000:1.0:1789448229.665581:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312256 00000100:00100000:1.0:1789448229.665603:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789448229.665609:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317312256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665635:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317312256:12345-0@lo:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.665641:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789448229.665660:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448229.665664:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448229.665700:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317311872:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.665709:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317311744:0@lo:400:kworker.0 00010000:00080000:1.0:1789448229.665719:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac7aa00 x1876372317312256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448229.665741:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789448229.665856:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317312000:0@lo:400:kworker.0 00000100:00100000:0.0:1789448229.665887:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448229.665918:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789448229.665924:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317311616:0@lo:400:kworker.0 00000100:00100000:0.0:1789448229.665959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448229.665979:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317312128:0@lo:400:kworker.0 00000100:00100000:0.0:1789448229.666000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448229.666078:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312000 00000100:00100000:1.0:1789448229.666083:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312000 00000100:00100000:1.0:1789448229.666121:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789448229.666129:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317312000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.666167:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317312000:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.666173:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789448229.666198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac78e00 x1876372317312000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448229.666208:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317312000:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.666242:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312128 00000100:00100000:1.0:1789448229.666246:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312128 00000100:00100000:1.0:1789448229.666268:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448229.666274:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317312128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.666302:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317312128:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.666307:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448229.666331:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317312128:0@lo:400:kworker.0 00000100:00080000:0.0:1789448229.666384:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448229.666388:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448229.666451:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317311616 00000100:00100000:3.0:1789448229.666456:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317311616 00000100:00100000:3.0:1789448229.666493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789448229.666500:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317311616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448229.666543:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317311616:12345-0@lo:400:kworker.0 Request processed in 43us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448229.666549:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789448229.666661:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317311616:0@lo:400:kworker.0 00000100:00100000:1.0:1789448229.834274:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448229.834326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448229.834357:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448229.834380:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448229.834446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261056 00000100:00100000:1.0:1789448229.834458:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261056 00000100:00100000:0.0:1789448229.834471:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261184 00000100:00100000:0.0:1789448229.834484:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261184 00000100:00100000:0.0:1789448229.834553:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261312 00000100:00100000:0.0:1789448229.834558:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261312 00000100:00100000:1.0:1789448229.834567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1789448229.834589:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295261056:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448229.834604:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789448229.834618:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295261184:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448229.834670:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295261056:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 90us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.834680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789448229.834691:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295261184:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448229.834700:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448229.834714:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789448229.834726:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295261312:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448229.834737:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295260928 00000100:00100000:0.0:1789448229.834744:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295260928 00000100:00100000:1.0:1789448229.834790:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295261312:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448229.834799:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00080000:1.0:1789448229.834824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448229.834828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448229.834831:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448229.835816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:0.0:1789448229.835833:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295260928:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448229.835892:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295260928:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 64us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448229.849978:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00010000:00010000:0.0:1789448230.041405:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448230.170657:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317312384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448230.170758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448230.170885:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312384 00000100:00100000:2.0:1789448230.170897:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312384 00000100:00100000:2.0:1789448230.170967:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448230.170979:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317312384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448230.171024:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448230.171158:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317312384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448230.171167:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789448230.183438:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6d80 x1876372317312384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448230.183483:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317312384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448230.686509:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448230.686536:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317312512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448230.686619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448230.686685:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312512 00000100:00100000:2.0:1789448230.686694:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312512 00000100:00100000:2.0:1789448230.686744:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448230.686752:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317312512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448230.686808:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448230.686852:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317312512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448230.686874:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789448230.686922:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b0a80 x1876372317312512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448230.686941:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317312512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789448231.068189:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448231.435724:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789448232.090647:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448233.113591:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448234.146714:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448234.779109:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317312640:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.779445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317313152:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.779694:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448234.779701:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317313024:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779738:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.779860:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317312768:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.779905:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317313280:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.779946:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448234.779952:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317312896:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.779975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448234.780010:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312640 00000100:00100000:3.0:1789448234.780019:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312640 00000100:00100000:3.0:1789448234.780061:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789448234.780071:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.780121:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317312640:12345-0@lo:400:kworker.0 Request processed in 50us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.780128:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789448234.780924:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313152 00000100:00100000:3.0:1789448234.780932:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313152 00000100:00100000:3.0:1789448234.780986:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312768 00000100:00100000:3.0:1789448234.780990:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312768 00000100:00100000:3.0:1789448234.781003:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317312896 00000100:00100000:3.0:1789448234.781006:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317312896 00000100:00100000:3.0:1789448234.781021:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789448234.781028:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317313152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.781082:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317313152:12345-0@lo:400:kworker.0 Request processed in 54us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.781089:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789448234.781102:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448234.781108:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317312768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.781142:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317312768:12345-0@lo:400:kworker.0 Request processed in 34us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.781148:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448234.781161:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448234.781166:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317312896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.781194:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317312896:12345-0@lo:400:kworker.0 Request processed in 27us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.781200:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448234.781248:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313024 00000100:00100000:2.0:1789448234.782203:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317312640:0@lo:400:kworker.0 00000100:00100000:2.0:1789448234.782269:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317313152:0@lo:400:kworker.0 00000100:00100000:2.0:1789448234.782308:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313280 00000100:00100000:2.0:1789448234.782313:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313280 00000100:00100000:2.0:1789448234.782352:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789448234.782359:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317313280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448234.782403:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317313280:12345-0@lo:400:kworker.0 Request processed in 45us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.782409:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789448234.782466:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317312896:0@lo:400:kworker.0 00000100:00100000:2.0:1789448234.782478:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317312768:0@lo:400:kworker.0 00010000:00080000:2.0:1789448234.782490:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6680 x1876372317313280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448234.782501:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317313280:0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.782761:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313024 00000100:00100000:3.0:1789448234.782857:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448234.782865:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317313024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448234.782907:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317313024:12345-0@lo:400:kworker.0 Request processed in 44us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.782913:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789448234.782937:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc6d80 x1876372317313024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448234.782947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317313024:0@lo:400:kworker.0 00000100:00080000:0.0:1789448234.783043:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448234.783048:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448234.783051:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448234.950435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448234.950480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448234.950507:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448234.950549:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448234.950574:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261568 00000100:00100000:1.0:1789448234.950583:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261568 00000100:00100000:1.0:1789448234.950642:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:1.0:1789448234.950654:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295261568:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448234.950736:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295261568:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448234.950743:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:1.0:1789448234.950766:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261696 00000100:00100000:1.0:1789448234.950769:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261696 00000100:00100000:1.0:1789448234.950793:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261824 00000100:00100000:1.0:1789448234.950796:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261824 00000100:00100000:1.0:1789448234.950811:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448234.950816:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2347:x1876372295261696:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789448234.950845:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9748 00000100:00080000:1.0:1789448234.950855:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d9f56ca000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789448234.950909:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789448234.951204:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+2:2347:x1876372295261696:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 386us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448234.951211:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448234.951248:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448234.951255:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2347:x1876372295261824:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789448234.951268:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f974f 00000100:00080000:1.0:1789448234.951274:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d9f56ce800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789448234.951297:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789448234.951502:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+2:2347:x1876372295261824:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 247us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448234.951514:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00010000:00010000:1.0:1789448234.951594:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448234.951668:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261440 00000100:00100000:0.0:1789448234.951673:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261440 00000100:00100000:0.0:1789448234.951713:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:0.0:1789448234.951731:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295261440:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448234.951762:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295261440:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448234.951769:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00080000:0.0:1789448234.951796:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448234.951800:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448234.951803:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789448234.951934:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448235.161401:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448235.294012:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317313408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448235.294096:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448235.294247:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313408 00000100:00100000:2.0:1789448235.294255:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313408 00000100:00100000:2.0:1789448235.294306:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448235.294321:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317313408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448235.294358:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448235.294405:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317313408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448235.294412:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789448235.295451:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0a80 x1876372317313408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448235.295473:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317313408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448235.803267:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448235.803292:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317313536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448235.803360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448235.803389:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313536 00000100:00100000:1.0:1789448235.803397:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313536 00000100:00100000:1.0:1789448235.803453:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789448235.803462:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317313536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448235.803496:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448235.803554:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317313536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448235.803561:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789448235.803731:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eada0a80 x1876372317313536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448235.803752:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317313536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448236.186279:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448237.209992:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789448237.222926:0:9034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing yml_node 00000001:00100000:3.0:1789448237.918565:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:3.0:1789448237.918574:0:6696:0:(genops.c:885:class_export_put()) final put ffff97d9f56cb800/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:3.0:1789448237.918603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9f56cb800/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-OST0000 00000020:00000080:3.0:1789448237.918647:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9f56ca000 for lustre-OST0000 00010000:00010000:2.0:1789448238.234366:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448239.258262:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789448239.466331:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:2.0:1789448239.466341:0:7625:0:(genops.c:885:class_export_put()) final put ffff97d9f56ca800/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:1.0:1789448239.466431:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9f56ca800/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-OST0001 00000020:00000080:1.0:1789448239.466491:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9f56ce800 for lustre-OST0001 00000100:00100000:3.0:1789448239.897609:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317313920:0@lo:400:kworker.0 00000100:00100000:3.0:1789448239.897692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448239.897765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789448239.897772:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317313792:0@lo:400:kworker.0 00000100:00100000:3.0:1789448239.897795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448239.897812:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317314304:0@lo:400:kworker.0 00000100:00100000:3.0:1789448239.897832:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448239.897871:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314304 00000100:00100000:3.0:1789448239.897878:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314304 00000100:00100000:3.0:1789448239.897932:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448239.897948:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317314304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448239.898004:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317314304:12345-0@lo:400:kworker.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448239.898011:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789448239.898052:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0100e00 x1876372317314304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448239.898065:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317314304:0@lo:400:kworker.0 00000100:00100000:2.0:1789448239.898168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313920 00000100:00100000:2.0:1789448239.898173:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313920 00000100:00100000:2.0:1789448239.898207:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313792 00000100:00100000:2.0:1789448239.898211:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313792 00000100:00100000:2.0:1789448239.898266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448239.898274:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317313920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448239.898313:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317313920:12345-0@lo:400:kworker.0 Request processed in 40us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.898319:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448239.898333:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789448239.898338:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317313792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448239.898364:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317313792:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.898369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789448239.898398:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317313792:0@lo:400:kworker.0 00000100:00100000:2.0:1789448239.898409:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317313920:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.898907:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317313664:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.898968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448239.899000:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317314176:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899023:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448239.899042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448239.899048:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317314048:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899067:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789448239.899092:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448239.899097:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448239.899107:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317313664 00000100:00100000:0.0:1789448239.899112:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317313664 00000100:00100000:0.0:1789448239.899142:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789448239.899148:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317313664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899185:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317313664:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.899209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789448239.899266:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314048 00000100:00100000:0.0:1789448239.899270:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314048 00000100:00100000:0.0:1789448239.899302:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448239.899308:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317314048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899338:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317314048:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.899345:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789448239.899361:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789448239.899385:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0103480 x1876372317314048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448239.899398:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317314048:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899407:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317313664:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314176 00000100:00100000:0.0:1789448239.899430:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314176 00000100:00100000:0.0:1789448239.899457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789448239.899462:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317314176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.899494:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317314176:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.899499:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789448239.899514:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448239.899530:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317314176:0@lo:400:kworker.0 00000100:00100000:3.0:1789448240.066315:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448240.066374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448240.066551:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295261952 00000100:00100000:1.0:1789448240.066561:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295261952 00000100:00100000:1.0:1789448240.066619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:1.0:1789448240.066628:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295261952:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448240.066739:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295261952:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 111us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448240.066747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:2.0:1789448240.067003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262080 00000100:00100000:2.0:1789448240.067008:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262080 00000100:00100000:2.0:1789448240.067087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1789448240.067096:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295262080:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448240.067133:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295262080:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448240.067140:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00080000:1.0:1789448240.067256:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789448240.281437:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448240.409479:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317314432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448240.409552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448240.410070:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314432 00000100:00100000:3.0:1789448240.410080:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314432 00000100:00100000:3.0:1789448240.410139:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448240.410149:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317314432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448240.410184:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448240.410272:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317314432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448240.410280:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789448240.410591:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0102680 x1876372317314432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448240.410613:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317314432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448240.923174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448240.923196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317314560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448240.923280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448240.923814:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314560 00000100:00100000:3.0:1789448240.923824:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314560 00000100:00100000:3.0:1789448240.923881:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789448240.923890:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317314560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448240.923923:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448240.923975:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317314560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448240.923982:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789448240.924839:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0100000 x1876372317314560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448240.924862:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317314560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448241.305507:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448242.334942:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448242.660172:0:9228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00010000:00010000:0.0:1789448243.353426:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448244.390357:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448245.018263:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317315072:0@lo:400:kworker.0 00000100:00100000:3.0:1789448245.018383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448245.018482:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789448245.018489:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317314688:0@lo:400:kworker.0 00000100:00100000:3.0:1789448245.018533:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448245.018559:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317315200:0@lo:400:kworker.0 00000100:00100000:3.0:1789448245.018586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448245.019272:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317314816:0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.019322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448245.019351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317315328:0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.019374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448245.019396:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448245.019402:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317314944:0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.019437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448245.019469:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314688 00000100:00100000:0.0:1789448245.019479:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314688 00000100:00100000:0.0:1789448245.019544:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789448245.019553:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.019614:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317314688:12345-0@lo:400:kworker.0 Request processed in 61us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448245.019621:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789448245.019761:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315200 00000100:00100000:0.0:1789448245.019765:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315200 00000100:00100000:0.0:1789448245.019806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314816 00000100:00100000:0.0:1789448245.019809:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314816 00000100:00100000:0.0:1789448245.019821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317314944 00000100:00100000:0.0:1789448245.019823:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317314944 00000100:00100000:0.0:1789448245.019838:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789448245.019843:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317315200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.020359:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317315200:12345-0@lo:400:kworker.0 Request processed in 512us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448245.020366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789448245.020384:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789448245.020390:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317314816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448245.020545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789448245.020555:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317314944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448245.020601:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317314944:12345-0@lo:400:kworker.0 Request processed in 49us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448245.020606:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789448245.020689:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317314944:0@lo:400:kworker.0 00000100:00100000:3.0:1789448245.020846:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315072 00000100:00100000:1.0:1789448245.021061:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315328 00000100:00100000:1.0:1789448245.021068:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315328 00000100:00100000:1.0:1789448245.021119:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448245.021128:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317315328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448245.021184:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317315328:12345-0@lo:400:kworker.0 Request processed in 57us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448245.021191:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789448245.021264:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448245.021270:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448245.021456:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317314688:0@lo:400:kworker.0 00000100:00100000:1.0:1789448245.021470:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317315200:0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.021709:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317314816:12345-0@lo:400:kworker.0 Request processed in 1258us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448245.021728:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789448245.024279:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315072 00000100:00100000:3.0:1789448245.024392:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448245.024404:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448245.024533:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317315072:12345-0@lo:400:kworker.0 Request processed in 132us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448245.024540:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789448245.026799:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789448245.026888:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac7ad80 x1876372317315072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448245.026909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317315072:0@lo:400:kworker.0 00000100:00100000:2.0:1789448245.037813:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317314816:0@lo:400:kworker.0 00010000:00080000:2.0:1789448245.037844:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac78700 x1876372317315328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448245.037868:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317315328:0@lo:400:kworker.0 00000100:00100000:0.0:1789448245.194320:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448245.194386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448245.194492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262336 00000100:00100000:2.0:1789448245.194505:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262336 00000100:00100000:2.0:1789448245.194607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789448245.194621:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295262336:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448245.194730:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295262336:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 111us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448245.194738:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789448245.195248:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262208 00000100:00100000:1.0:1789448245.195254:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262208 00000100:00100000:1.0:1789448245.195300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1789448245.195308:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2351:x1876372295262208:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448245.195355:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2351:x1876372295262208:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 49us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448245.195361:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00080000:0.0:1789448245.201968:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448245.402202:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448245.530273:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317315456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448245.530370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448245.532296:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315456 00000100:00100000:3.0:1789448245.532314:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315456 00000100:00100000:3.0:1789448245.532399:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789448245.532419:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317315456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448245.532476:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448245.532591:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317315456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448245.532599:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789448245.532891:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101f80 x1876372317315456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448245.532919:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317315456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448246.042021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317315584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448246.042096:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448246.042336:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315584 00000100:00100000:3.0:1789448246.042344:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315584 00000100:00100000:3.0:1789448246.042392:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448246.042401:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317315584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448246.042431:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448246.042492:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317315584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448246.042499:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789448246.046928:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101c00 x1876372317315584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448246.046957:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317315584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789448246.426918:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448246.694501:0:9326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:1.0:1789448247.451776:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448248.473550:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448249.498485:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448250.151874:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317316096:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.151965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152026:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789448250.152032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317315712:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152086:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317316224:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152137:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317315840:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152176:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317316352:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152196:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152213:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448250.152252:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317315968:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152297:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448250.152334:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315712 00000100:00100000:0.0:1789448250.152341:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315712 00000100:00100000:0.0:1789448250.152393:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789448250.152402:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317315712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152453:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317315712:12345-0@lo:400:kworker.0 Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448250.152460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789448250.152490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316224 00000100:00100000:0.0:1789448250.152494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316224 00000100:00100000:0.0:1789448250.152527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315840 00000100:00100000:0.0:1789448250.152530:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315840 00000100:00100000:0.0:1789448250.152541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317315968 00000100:00100000:0.0:1789448250.152543:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317315968 00000100:00100000:0.0:1789448250.152555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789448250.152561:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317316224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.152602:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317316224:12345-0@lo:400:kworker.0 Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448250.152608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789448250.153202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789448250.153215:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317315840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448250.153272:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317315840:12345-0@lo:400:kworker.0 Request processed in 62us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448250.153277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789448250.153292:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448250.153298:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317315968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448250.153324:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317315968:12345-0@lo:400:kworker.0 Request processed in 26us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448250.153329:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448250.153361:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316096 00000100:00100000:3.0:1789448250.153364:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316096 00000100:00100000:3.0:1789448250.153393:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316352 00000100:00100000:3.0:1789448250.153396:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316352 00000100:00100000:3.0:1789448250.153412:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448250.153418:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317316096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448250.153448:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317316096:12345-0@lo:400:kworker.0 Request processed in 31us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448250.153454:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448250.153466:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789448250.153471:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317316352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448250.153498:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317316352:12345-0@lo:400:kworker.0 Request processed in 27us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448250.153517:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789448250.153549:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448250.153553:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789448250.153555:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448250.153826:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317315712:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.153841:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317316224:0@lo:400:kworker.0 00010000:00080000:0.0:1789448250.153853:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac78700 x1876372317316096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448250.153864:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317316096:0@lo:400:kworker.0 00000100:00100000:0.0:1789448250.154349:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317315968:0@lo:400:kworker.0 00000100:00100000:1.0:1789448250.172496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317315840:0@lo:400:kworker.0 00010000:00080000:1.0:1789448250.172519:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac79c00 x1876372317316352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448250.172530:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317316352:0@lo:400:kworker.0 00000001:02000400:3.0:1789448250.292795:0:9424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:3.0:1789448250.334574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448250.334641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448250.334769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262464 00000100:00100000:2.0:1789448250.334779:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262464 00000100:00100000:2.0:1789448250.334840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:2.0:1789448250.334851:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2348:x1876372295262464:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448250.334922:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2348:x1876372295262464:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448250.334929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:0.0:1789448250.336595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262592 00000100:00100000:0.0:1789448250.336617:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262592 00000100:00100000:0.0:1789448250.336685:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789448250.336695:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295262592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448250.336782:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295262592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 89us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448250.336790:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00080000:3.0:1789448250.337512:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448250.527432:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448250.657749:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448250.657771:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317316480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448250.657840:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448250.657901:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316480 00000100:00100000:3.0:1789448250.657908:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316480 00000100:00100000:3.0:1789448250.657952:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448250.657961:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317316480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448250.657997:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448250.658041:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317316480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448250.658049:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789448250.664018:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101880 x1876372317316480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448250.664059:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317316480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448251.163161:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448251.163801:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317316608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448251.163901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448251.164077:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316608 00000100:00100000:3.0:1789448251.164090:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316608 00000100:00100000:3.0:1789448251.164182:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789448251.164192:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317316608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448251.164268:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448251.164341:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317316608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448251.164347:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789448251.164421:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101880 x1876372317316608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448251.164443:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317316608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448251.551662:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448252.569838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789448253.248532:0:9472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 00:57:30 EDT 2026 00010000:00010000:2.0:1789448253.597529:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448254.617378:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448255.258296:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317317120:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258439:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789448255.258446:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317316736:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258509:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317317248:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258622:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317316864:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258663:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317317376:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258932:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448255.258940:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317316992:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.258966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448255.258996:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317120 00000100:00100000:1.0:1789448255.259003:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317120 00000100:00100000:1.0:1789448255.259056:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317376 00000100:00100000:1.0:1789448255.259059:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317376 00000100:00100000:1.0:1789448255.259079:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448255.259088:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259152:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317317120:12345-0@lo:400:kworker.0 Request processed in 65us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259159:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448255.259178:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448255.259185:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259241:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317317376:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259248:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448255.259266:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316736 00000100:00100000:1.0:1789448255.259270:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316736 00000100:00100000:1.0:1789448255.259292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789448255.259298:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317316736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259327:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317316736:12345-0@lo:400:kworker.0 Request processed in 29us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789448255.259356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317248 00000100:00100000:1.0:1789448255.259359:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317248 00000100:00100000:1.0:1789448255.259382:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316864 00000100:00100000:1.0:1789448255.259384:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316864 00000100:00100000:1.0:1789448255.259393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317316992 00000100:00100000:1.0:1789448255.259395:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317316992 00000100:00100000:1.0:1789448255.259406:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789448255.259412:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259441:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317317248:12345-0@lo:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789448255.259460:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448255.259472:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259511:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317316864:12345-0@lo:400:kworker.0 Request processed in 39us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448255.259526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789448255.259542:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259580:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317316992:12345-0@lo:400:kworker.0 Request processed in 49us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.259586:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789448255.259716:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448255.259723:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448255.259725:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448255.259762:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317316992:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259773:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317316864:0@lo:400:kworker.0 00010000:00080000:1.0:1789448255.259782:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac79f80 x1876372317317376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448255.259792:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317317376:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259822:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317316736:0@lo:400:kworker.0 00000100:00100000:1.0:1789448255.259831:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317317248:0@lo:400:kworker.0 00010000:00080000:1.0:1789448255.259840:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac7bb80 x1876372317317120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448255.259850:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317317120:0@lo:400:kworker.0 00000100:00100000:0.0:1789448255.426689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448255.426747:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448255.426803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262848 00000100:00100000:1.0:1789448255.426825:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262848 00000100:00100000:1.0:1789448255.426907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1789448255.426917:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295262848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448255.427000:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295262848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448255.427008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1789448255.427553:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262720 00000100:00100000:3.0:1789448255.427558:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262720 00000100:00100000:3.0:1789448255.427598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:3.0:1789448255.427606:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295262720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448255.427646:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295262720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448255.427653:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00080000:0.0:1789448255.427906:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448255.646542:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448255.771869:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448255.771956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448255.772049:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317504 00000100:00100000:2.0:1789448255.772056:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317504 00000100:00100000:2.0:1789448255.772105:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789448255.772114:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317317504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448255.772149:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448255.778205:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317317504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6084us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448255.779711:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789448255.790795:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fec700 x1876372317317504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448255.790824:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448256.291571:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448256.291595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317317632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448256.292362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448256.293353:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317632 00000100:00100000:2.0:1789448256.293364:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317632 00000100:00100000:2.0:1789448256.293420:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789448256.293431:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317317632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448256.293471:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448256.293542:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317317632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448256.293550:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789448256.293725:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101500 x1876372317317632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448256.293747:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317317632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448256.667292:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448257.689442:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448258.713652:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448259.743823:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448260.385900:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317317760:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.385982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386027:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317318272:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386051:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386087:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448260.386094:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317318144:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386147:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317317888:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386168:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386183:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317318400:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386200:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386232:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448260.386238:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317318016:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448260.386302:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317760 00000100:00100000:2.0:1789448260.386308:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317760 00000100:00100000:2.0:1789448260.386353:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789448260.386361:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317317760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386408:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317317760:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.386415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789448260.386447:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318272 00000100:00100000:2.0:1789448260.386450:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318272 00000100:00100000:2.0:1789448260.386480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317317888 00000100:00100000:2.0:1789448260.386493:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317317888 00000100:00100000:2.0:1789448260.386506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318016 00000100:00100000:2.0:1789448260.386508:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318016 00000100:00100000:2.0:1789448260.386534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789448260.386540:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317318272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386572:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317318272:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.386577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789448260.386596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789448260.386601:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317317888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.386634:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317317888:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.386640:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789448260.386650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789448260.386655:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317318016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.387344:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317318016:12345-0@lo:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.387355:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789448260.387380:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318144 00000100:00100000:2.0:1789448260.387384:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318144 00000100:00100000:2.0:1789448260.387418:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318400 00000100:00100000:2.0:1789448260.387422:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318400 00000100:00100000:2.0:1789448260.387438:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789448260.387444:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317318144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.387498:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317318144:12345-0@lo:400:kworker.0 Request processed in 55us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.387505:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789448260.387525:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789448260.387531:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317318400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.387557:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317318400:12345-0@lo:400:kworker.0 Request processed in 27us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.387568:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789448260.387601:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448260.387605:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448260.387608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448260.387658:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317318016:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.387670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317317888:0@lo:400:kworker.0 00010000:00080000:2.0:1789448260.388024:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eafd3100 x1876372317318400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448260.388036:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317318400:0@lo:400:kworker.0 00010000:00080000:2.0:1789448260.388082:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc4700 x1876372317318144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448260.388092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317318144:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.388101:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317317760:0@lo:400:kworker.0 00000100:00100000:2.0:1789448260.388112:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317318272:0@lo:400:kworker.0 00000100:00100000:0.0:1789448260.560012:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448260.560057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448260.560152:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295262976 00000100:00100000:3.0:1789448260.560162:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295262976 00000100:00100000:3.0:1789448260.560250:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:3.0:1789448260.560260:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295262976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448260.560334:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295262976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448260.560341:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1789448260.561093:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263104 00000100:00100000:2.0:1789448260.561100:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263104 00000100:00100000:2.0:1789448260.561166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789448260.561174:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295263104:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448260.561262:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295263104:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 89us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448260.561276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00080000:0.0:1789448260.561929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448260.767846:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448260.890504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448260.890579:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448260.890702:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318528 00000100:00100000:3.0:1789448260.890714:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318528 00000100:00100000:3.0:1789448260.890775:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448260.890785:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317318528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448260.890829:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448260.890909:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317318528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448260.890916:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789448260.891000:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fec380 x1876372317318528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448260.891020:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448261.414525:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448261.414548:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317318656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448261.414612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448261.414677:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318656 00000100:00100000:0.0:1789448261.414684:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318656 00000100:00100000:0.0:1789448261.414725:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448261.414733:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317318656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448261.414764:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448261.414813:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317318656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448261.414820:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789448261.414858:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fefb80 x1876372317318656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448261.414882:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317318656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448261.789857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448262.820365:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448263.836940:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448264.866284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448265.498429:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317318912:0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.498523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448265.498585:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317319424:0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.498627:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448265.498658:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448265.498664:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317319040:0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.498701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448265.498737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318912 00000100:00100000:2.0:1789448265.498746:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318912 00000100:00100000:2.0:1789448265.498790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319040 00000100:00100000:2.0:1789448265.498793:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319040 00000100:00100000:2.0:1789448265.498824:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789448265.498832:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317318912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.498887:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317318912:12345-0@lo:400:kworker.0 Request processed in 55us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448265.498907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789448265.498929:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789448265.498936:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317319040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.498965:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317319040:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448265.498971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789448265.498991:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319424 00000100:00100000:2.0:1789448265.498994:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319424 00000100:00100000:2.0:1789448265.499022:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789448265.499030:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.499060:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317319424:12345-0@lo:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448265.499065:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789448265.499123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317319040:0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.499147:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317318912:0@lo:400:kworker.0 00010000:00080000:2.0:1789448265.499159:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc4700 x1876372317319424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448265.499169:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317319424:0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499408:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317318784:0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448265.499502:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317319296:0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499524:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448265.499545:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448265.499551:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317319168:0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448265.499605:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319168 00000100:00100000:1.0:1789448265.499609:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319168 00000100:00100000:1.0:1789448265.499637:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789448265.499644:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317319168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499680:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317319168:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448265.499686:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789448265.499711:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eacc4000 x1876372317319168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448265.499721:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317319168:0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499736:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319296 00000100:00100000:1.0:1789448265.499739:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319296 00000100:00100000:1.0:1789448265.499762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448265.499768:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317319296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448265.499799:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317319296:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448265.499804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448265.499825:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317319296:0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.500019:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317318784 00000100:00100000:2.0:1789448265.500023:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317318784 00000100:00100000:2.0:1789448265.500049:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789448265.500055:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448265.500090:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317318784:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448265.500096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1789448265.501669:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448265.501678:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448265.501681:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448265.501827:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317318784:0@lo:400:kworker.0 00000100:00100000:0.0:1789448265.665185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448265.665270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448265.665301:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263232 00000100:00100000:0.0:1789448265.665311:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263232 00000100:00100000:0.0:1789448265.665362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:0.0:1789448265.665373:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2351:x1876372295263232:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448265.665454:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2351:x1876372295263232:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448265.665461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:3.0:1789448265.665835:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263360 00000100:00100000:3.0:1789448265.665840:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263360 00000100:00100000:3.0:1789448265.665887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1789448265.665895:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295263360:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448265.665934:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295263360:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448265.665941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00080000:0.0:1789448265.666355:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448265.882375:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448266.012381:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448266.012407:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317319552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448266.012493:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448266.012613:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319552 00000100:00100000:0.0:1789448266.012621:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319552 00000100:00100000:0.0:1789448266.012678:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789448266.012688:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317319552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448266.012722:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448266.012777:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317319552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448266.012784:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789448266.012823:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fef100 x1876372317319552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448266.012840:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317319552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448266.529012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317319680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448266.529086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448266.529369:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319680 00000100:00100000:3.0:1789448266.529378:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319680 00000100:00100000:3.0:1789448266.529441:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789448266.529451:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317319680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448266.529494:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448266.530511:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317319680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1003us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448266.530595:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789448266.530668:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fef100 x1876372317319680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448266.530690:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317319680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448266.916372:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448267.942146:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448268.954176:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448269.977498:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448270.620056:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317319936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448270.620124:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448270.620198:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317320448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448270.620255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448270.620287:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448270.620293:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317320064:0@lo:400:kworker.0 00000100:00100000:1.0:1789448270.620315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448270.620455:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317320192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.620487:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448270.620523:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319936 00000100:00100000:1.0:1789448270.620533:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319936 00000100:00100000:2.0:1789448270.620614:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317319808:0@lo:400:kworker.0 00000100:00100000:2.0:1789448270.620650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448270.629297:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320448 00000100:00100000:1.0:1789448270.629312:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320448 00000100:00100000:0.0:1789448270.629682:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320064 00000100:00100000:0.0:1789448270.629688:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320064 00000100:00100000:1.0:1789448270.629773:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320192 00000100:00100000:1.0:1789448270.629778:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320192 00000100:00100000:2.0:1789448270.629878:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317320320:0@lo:400:kworker.0 00000100:00100000:2.0:1789448270.629935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448270.629991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320320 00000100:00100000:2.0:1789448270.629995:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320320 00000100:00100000:0.0:1789448270.631612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789448270.631628:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317319936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.631724:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317319936:12345-0@lo:400:kworker.0 Request processed in 101us (11600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448270.631732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789448270.631750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448270.631757:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317320064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.631783:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317320064:12345-0@lo:400:kworker.0 Request processed in 28us (11467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448270.631789:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448270.631833:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448270.631841:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317320448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.631872:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317320448:12345-0@lo:400:kworker.0 Request processed in 33us (11617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448270.631878:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789448270.631915:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448270.631921:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448270.631923:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448270.631950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317319808 00000100:00100000:0.0:1789448270.631957:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317319808 00000100:00100000:0.0:1789448270.631985:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789448270.631992:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317319808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.632046:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317319808:12345-0@lo:400:kworker.0 Request processed in 55us (11395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448270.632052:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789448270.632119:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317320064:0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.632132:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317319936:0@lo:400:kworker.0 00010000:00080000:0.0:1789448270.632144:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb035c00 x1876372317320448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448270.632155:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317320448:0@lo:400:kworker.0 00000100:00100000:0.0:1789448270.632198:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317319808:0@lo:400:kworker.0 00000100:00100000:1.0:1789448270.641905:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448270.641922:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317320192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448270.642021:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317320192:12345-0@lo:400:kworker.0 Request processed in 103us (21531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448270.642028:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789448270.642075:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb036300 x1876372317320192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448270.642104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317320192:0@lo:400:kworker.0 00000100:00100000:2.0:1789448270.642408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448270.642417:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317320320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448270.642462:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317320320:12345-0@lo:400:kworker.0 Request processed in 46us (12526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448270.642475:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448270.642527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317320320:0@lo:400:kworker.0 00000100:00100000:3.0:1789448270.782788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448270.782907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448270.783018:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263488 00000100:00100000:0.0:1789448270.783029:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263488 00000100:00100000:0.0:1789448270.783089:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:0.0:1789448270.783100:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295263488:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448270.783179:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295263488:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448270.783185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:1.0:1789448270.783773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263616 00000100:00100000:1.0:1789448270.783778:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263616 00000100:00100000:1.0:1789448270.783900:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1789448270.783909:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295263616:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448270.783959:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295263616:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448270.783965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00080000:0.0:1789448270.784635:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448271.004463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448271.135872:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317320576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448271.135942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448271.136009:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320576 00000100:00100000:3.0:1789448271.136018:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320576 00000100:00100000:3.0:1789448271.136084:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789448271.136093:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317320576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448271.136127:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448271.136179:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317320576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448271.136200:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789448271.136258:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d0101880 x1876372317320576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448271.136275:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317320576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448271.646326:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317320704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448271.646398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448271.646639:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320704 00000100:00100000:2.0:1789448271.646648:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320704 00000100:00100000:2.0:1789448271.646765:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789448271.646774:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317320704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448271.646809:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448271.647184:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317320704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 410us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448271.647191:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789448271.647590:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fed180 x1876372317320704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448271.647611:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317320704:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789448271.772966:0:10103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:57:50 (1789448270) === 00010000:00010000:3.0:1789448272.025556:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448272.443901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.444121:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263744 00000100:00100000:0.0:1789448272.444146:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263744 00000100:00100000:0.0:1789448272.444208:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:0.0:1789448272.446829:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+10:8138:x1876372295263744:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448272.446862:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448272.446900:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32e00/0xe29566c2465f9813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ebdc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.446941:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32e00/0xe29566c2465f9813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebdc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.446953:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32e00/0xe29566c2465f9813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebdc expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.446965:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32e00, rc 0) 00000100:00100000:0.0:1789448272.449401:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295263744:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 5159us (5486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.449420:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:3.0:1789448272.461009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.461190:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295263872 00000100:00100000:2.0:1789448272.461205:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295263872 00000100:00100000:2.0:1789448272.461316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:2.0:1789448272.461329:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295263872:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448272.463409:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295263872:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 2069us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.463427:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:3.0:1789448272.468561:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.468725:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264000 00000100:00100000:0.0:1789448272.468736:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264000 00000100:00100000:0.0:1789448272.468809:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:0.0:1789448272.468819:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295264000:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789448272.469057:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295264000:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 239us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.469066:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:3.0:1789448272.475644:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.477991:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264128 00000100:00100000:2.0:1789448272.478007:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264128 00000100:00100000:2.0:1789448272.478201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:2.0:1789448272.478212:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:8142:x1876372295264128:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448272.478594:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:8142:x1876372295264128:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 382us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.478602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:3.0:1789448272.498050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.498800:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264256 00000100:00100000:2.0:1789448272.498812:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264256 00000100:00100000:2.0:1789448272.498873:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:2.0:1789448272.498883:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+11:8142:x1876372295264256:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448272.499201:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+11:8142:x1876372295264256:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 318us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.499210:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:3.0:1789448272.503561:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.503993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264384 00000100:00100000:2.0:1789448272.504003:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264384 00000100:00100000:2.0:1789448272.504076:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1789448272.504083:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:8138:x1876372295264384:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789448272.504098:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448272.504115:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2c00/0xe29566c2465f981a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec06 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448272.504145:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2c00/0xe29566c2465f981a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec06 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448272.504157:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2c00/0xe29566c2465f981a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec06 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448272.504166:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2c00, rc 0) 00000100:00100000:2.0:1789448272.504252:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:8138:x1876372295264384:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 168us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.504259:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:3.0:1789448272.511173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.511296:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264512 00000100:00100000:0.0:1789448272.511307:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264512 00000100:00100000:0.0:1789448272.511364:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:0.0:1789448272.511383:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:8138:x1876372295264512:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789448272.511419:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789448272.511433:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789448272.511436:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789448272.511438:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789448272.511440:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789448272.515606:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:8138:x1876372295264512:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 4222us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.515621:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:3.0:1789448272.519324:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.520135:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264640 00000100:00100000:0.0:1789448272.520147:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264640 00000100:00100000:0.0:1789448272.520278:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:0.0:1789448272.520289:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:8138:x1876372295264640:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448272.520307:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448272.520324:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec0d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.520352:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.520363:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448272.520382:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33200, rc 0) 00000100:00100000:0.0:1789448272.520443:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:8138:x1876372295264640:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 156us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.520450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:3.0:1789448272.523138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.523274:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264768 00000100:00100000:0.0:1789448272.523295:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264768 00000100:00100000:0.0:1789448272.523342:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:0.0:1789448272.523351:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:8138:x1876372295264768:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789448272.523699:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:8138:x1876372295264768:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 348us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.523708:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:3.0:1789448272.532660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.532819:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295264896 00000100:00100000:0.0:1789448272.532840:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295264896 00000100:00100000:0.0:1789448272.532900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:0.0:1789448272.532911:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:8138:x1876372295264896:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789448272.533350:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:8138:x1876372295264896:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 439us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.533358:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1789448272.543390:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.544983:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265024 00000100:00100000:2.0:1789448272.544995:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265024 00000100:00100000:2.0:1789448272.546259:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:2.0:1789448272.546276:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:8144:x1876372295265024:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448272.546558:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:8144:x1876372295265024:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 288us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.546566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:3.0:1789448272.550698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.550801:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265152 00000100:00100000:0.0:1789448272.550812:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265152 00000100:00100000:0.0:1789448272.550879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1789448272.550889:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:8144:x1876372295265152:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448272.551147:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:8144:x1876372295265152:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 258us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.551156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:3.0:1789448272.559160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.559392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265280 00000100:00100000:2.0:1789448272.559402:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265280 00000100:00100000:3.0:1789448272.559409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448272.559447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265664 00000100:00100000:2.0:1789448272.559451:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265664 00000100:00100000:2.0:1789448272.559524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789448272.559534:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295265664:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:3.0:1789448272.559581:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448272.559623:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295265664:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.559630:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789448272.559649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789448272.559654:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1876372295265280:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789448272.559677:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 30b293c1-5fe6-41b6-9c68-6199a552e486@192.168.202.54@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:2.0:1789448272.559714:0:5833:0:(genops.c:1384:class_connect()) connect: client 30b293c1-5fe6-41b6-9c68-6199a552e486, cookie 0xe29566c2465f9828 00000004:00100000:2.0:1789448272.559743:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789448272.560034:0:5833:0:(import.c:65:import_set_state_nolock()) ffff97d9ffe1a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448272.560078:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2347:x1876372295265280:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 422us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448272.560085:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1789448272.563878:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448272.564526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.564948:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265536 00000100:00100000:0.0:1789448272.564959:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265536 00000100:00100000:0.0:1789448272.565148:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265408 00000100:00100000:0.0:1789448272.565153:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265408 00000100:00080000:3.0:1789448272.565204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448272.566150:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448272.566206:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+7:8138:x1876372295265536:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789448272.566336:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789448272.566545:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+7:8138:x1876372295265536:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 344us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448272.566554:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448272.566578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789448272.566586:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:0:x1876372295265408:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789448272.566599:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789448272.566692:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:0:x1876372295265408:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 106us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448272.566699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789448272.569594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448272.569688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265792 00000100:00100000:1.0:1789448272.569698:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265792 00000100:00100000:1.0:1789448272.569750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448272.569761:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:8138:x1876372295265792:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789448272.570632:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:8138:x1876372295265792:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 869us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448272.570641:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789448272.573404:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.573558:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295265920 00000100:00100000:0.0:1789448272.573567:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295265920 00000100:00100000:0.0:1789448272.573613:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789448272.573634:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876372295265920:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789448272.573663:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 30b293c1-5fe6-41b6-9c68-6199a552e486@192.168.202.54@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:0.0:1789448272.573694:0:6672:0:(genops.c:1384:class_connect()) connect: client 30b293c1-5fe6-41b6-9c68-6199a552e486, cookie 0xe29566c2465f982f 00002000:00100000:0.0:1789448272.573705:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 30b293c1-5fe6-41b6-9c68-6199a552e486/ffff97d9ce9fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448272.573718:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789448272.574006:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789448272.574152:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d9ce9fe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448272.574247:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2347:x1876372295265920:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 584us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.574256:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789448272.575962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448272.576055:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266048 00000100:00100000:1.0:1789448272.576065:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266048 00000100:00100000:1.0:1789448272.576107:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448272.576115:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1876372295266048:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789448272.576146:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 30b293c1-5fe6-41b6-9c68-6199a552e486@192.168.202.54@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:1.0:1789448272.576174:0:6671:0:(genops.c:1384:class_connect()) connect: client 30b293c1-5fe6-41b6-9c68-6199a552e486, cookie 0xe29566c2465f9836 00002000:00100000:1.0:1789448272.576185:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30b293c1-5fe6-41b6-9c68-6199a552e486/ffff97d8c2306800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448272.576209:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789448272.576647:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448272.576673:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97d8c2304000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448272.576826:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2347:x1876372295266048:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 709us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448272.576844:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789448272.581645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448272.581747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266176 00000100:00100000:0.0:1789448272.581758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266176 00000100:00100000:0.0:1789448272.581822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789448272.581842:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+6:8138:x1876372295266176:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789448272.581918:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789448272.582006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+6:8138:x1876372295266176:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448272.582014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00010000:00010000:1.0:1789448273.051668:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789448273.780624:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00010000:00010000:2.0:1789448274.073406:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448275.098475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789448275.304888:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00000001:00100000:1.0:1789448275.342067:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00000100:00100000:3.0:1789448275.738728:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317321216:0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.739001:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448275.739075:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789448275.739082:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317320832:0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.739114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448275.739124:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321216 00000100:00100000:1.0:1789448275.739133:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321216 00000100:00100000:3.0:1789448275.739138:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317321344:0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.739161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448275.739186:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317320960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448275.739186:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789448275.739196:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317321216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.739211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448275.739256:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317321472:0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.739279:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448275.739279:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317321216:12345-0@lo:400:kworker.0 Request processed in 84us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448275.739287:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448275.739294:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448275.739299:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317321088:0@lo:400:kworker.0 00000100:00100000:1.0:1789448275.739300:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321472 00000100:00100000:1.0:1789448275.739303:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321472 00000100:00100000:3.0:1789448275.739318:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448275.739359:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320832 00000100:00100000:3.0:1789448275.739363:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320832 00000100:00100000:1.0:1789448275.739458:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789448275.739465:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317321472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448275.739503:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317321472:12345-0@lo:400:kworker.0 Request processed in 39us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448275.739510:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789448275.740071:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789448275.740080:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317320832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448275.740116:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317320832:12345-0@lo:400:kworker.0 Request processed in 38us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448275.740123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789448275.758276:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321344 00000100:00100000:2.0:1789448275.758294:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321344 00000100:00100000:2.0:1789448275.758488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317320960 00000100:00100000:2.0:1789448275.758492:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317320960 00000100:00100000:2.0:1789448275.758509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321088 00000100:00100000:2.0:1789448275.758512:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321088 00000100:00100000:2.0:1789448275.758532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448275.758541:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317321344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448275.758628:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317321344:12345-0@lo:400:kworker.0 Request processed in 88us (19465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448275.758636:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448275.758655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448275.758660:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317320960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448275.758690:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317320960:12345-0@lo:400:kworker.0 Request processed in 30us (19478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448275.758696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448275.758711:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789448275.758717:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317321088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448275.758745:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317321088:12345-0@lo:400:kworker.0 Request processed in 29us (19426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448275.758751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789448275.758774:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448275.758778:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448275.758782:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448275.758973:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317320832:0@lo:400:kworker.0 00000100:00100000:2.0:1789448275.758989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317321344:0@lo:400:kworker.0 00010000:00080000:2.0:1789448275.759022:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf14380 x1876372317321216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448275.759033:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317321216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448275.759260:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317321088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448275.759272:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317320960:0@lo:400:kworker.0 00010000:00080000:0.0:1789448275.759284:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf17480 x1876372317321472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448275.759293:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317321472:0@lo:400:kworker.0 00010000:00010000:1.0:1789448276.121598:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448276.249526:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317321600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448276.249610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448276.249851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321600 00000100:00100000:3.0:1789448276.249860:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321600 00000100:00100000:3.0:1789448276.249915:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789448276.249925:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317321600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448276.249961:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448276.250029:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317321600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448276.250036:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789448276.250134:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf14a80 x1876372317321600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448276.250153:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317321600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448276.767472:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448276.767496:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317321728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448276.767562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448276.767624:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321728 00000100:00100000:0.0:1789448276.767632:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321728 00000100:00100000:0.0:1789448276.767682:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448276.767691:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317321728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448276.767726:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448276.767769:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317321728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448276.767776:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789448276.767819:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fee680 x1876372317321728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448276.767838:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317321728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448277.146130:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448277.959007:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448277.959072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448277.959123:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448277.959166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448277.959194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448277.959300:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266688 00000100:00100000:3.0:1789448277.959313:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266688 00000100:00100000:3.0:1789448277.959408:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266816 00000100:00100000:3.0:1789448277.959412:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266816 00000100:00100000:3.0:1789448277.959434:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1789448277.959447:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266688:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448277.959677:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789448277.959690:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789448277.959728:0:6671:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789448277.959740:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789448277.959749:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266816:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448277.959805:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266816:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 57us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448277.959833:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:1.0:1789448277.961433:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266304 00000100:00100000:1.0:1789448277.961451:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266304 00000100:00100000:1.0:1789448277.961545:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:1.0:1789448277.961566:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295266304:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448277.961570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266432 00000100:00100000:2.0:1789448277.961585:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266432 00000100:00100000:1.0:1789448277.961668:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295266304:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 110us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448277.961672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266560 00000100:00100000:2.0:1789448277.961677:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266560 00000100:00100000:1.0:1789448277.961692:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:2.0:1789448277.961801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:2.0:1789448277.961816:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295266432:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448277.961878:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295266432:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 67us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448277.961921:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:1.0:1789448277.961935:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266560:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448277.961990:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266560:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 59us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448277.961998:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00080000:1.0:1789448277.962022:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448277.962027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448277.962030:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448277.962106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1789448277.964071:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295266688:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 4611us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448277.964086:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00010000:00010000:2.0:1789448278.170898:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448279.195896:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448279.951812:0:10304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789448280.219154:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448280.858585:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317322240:0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.858657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448280.858667:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317321856:0@lo:400:kworker.0 00000100:00100000:3.0:1789448280.858711:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448280.858740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317322368:0@lo:400:kworker.0 00000100:00100000:3.0:1789448280.858854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448280.858899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321856 00000100:00100000:3.0:1789448280.858905:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321856 00000100:00100000:3.0:1789448280.858948:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789448280.858958:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317321856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448280.859008:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317321856:12345-0@lo:400:kworker.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448280.859024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789448280.859059:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322240 00000100:00100000:3.0:1789448280.859064:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322368 00000100:00100000:0.0:1789448280.859066:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322240 00000100:00100000:3.0:1789448280.859070:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322368 00000100:00100000:0.0:1789448280.859113:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448280.859120:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317322240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448280.859160:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317322240:12345-0@lo:400:kworker.0 Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448280.859168:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448280.859193:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317322112:0@lo:400:kworker.0 00000100:00100000:0.0:1789448280.859240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448280.859265:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789448280.859271:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317321984:0@lo:400:kworker.0 00000100:00100000:0.0:1789448280.859294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448280.859326:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317322496:0@lo:400:kworker.0 00000100:00100000:0.0:1789448280.859347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789448280.859424:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d138d880 x1876372317322240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448280.859441:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322112 00000100:00100000:3.0:1789448280.859446:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322112 00000100:00100000:3.0:1789448280.859460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317321984 00000100:00100000:3.0:1789448280.859463:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317321984 00000100:00100000:3.0:1789448280.859475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789448280.859482:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859499:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317322240:0@lo:400:kworker.0 00000100:00100000:3.0:1789448280.859523:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317322368:12345-0@lo:400:kworker.0 Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448280.859530:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789448280.859547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789448280.859554:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317322112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859558:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317321856:0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859571:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317322368:0@lo:400:kworker.0 00000100:00100000:3.0:1789448280.859593:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317322112:12345-0@lo:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448280.859599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789448280.859651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448280.859660:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859699:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317321984:12345-0@lo:400:kworker.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448280.859707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448280.859741:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317321984:0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859749:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317322112:0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859775:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322496 00000100:00100000:2.0:1789448280.859778:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322496 00000100:00100000:2.0:1789448280.859807:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448280.859813:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317322496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448280.859850:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317322496:12345-0@lo:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448280.859857:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789448280.859868:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d138d500 x1876372317322496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448280.859880:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317322496:0@lo:400:kworker.0 00000100:00080000:0.0:1789448280.859963:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448280.859968:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448280.859970:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789448281.246714:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448281.382634:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448281.382657:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317322624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448281.382725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448281.382784:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322624 00000100:00100000:3.0:1789448281.382792:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322624 00000100:00100000:3.0:1789448281.382836:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448281.382851:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317322624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448281.382889:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448281.382934:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317322624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448281.382940:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789448281.382981:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf15c00 x1876372317322624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448281.382998:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317322624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448281.881515:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448281.881545:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317322752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448281.881645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448281.881954:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322752 00000100:00100000:1.0:1789448281.881972:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322752 00000100:00100000:1.0:1789448281.882045:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448281.882056:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317322752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448281.882100:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448281.882196:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317322752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448281.882204:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789448281.883057:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4fedf80 x1876372317322752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448281.883087:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317322752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448282.266458:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448283.101110:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448283.101176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448283.101205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448283.101245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448283.101274:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448283.101358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267072 00000100:00100000:0.0:1789448283.101372:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267072 00000100:00100000:0.0:1789448283.101442:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267200 00000100:00100000:0.0:1789448283.101446:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267200 00000100:00100000:0.0:1789448283.101476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:0.0:1789448283.101487:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295267072:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448283.101596:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295267072:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 111us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448283.101605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:0.0:1789448283.101643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1789448283.101651:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267200:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448283.101680:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267200:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448283.101687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1789448283.101708:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267328 00000100:00100000:0.0:1789448283.101712:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267328 00000100:00100000:0.0:1789448283.101743:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267456 00000100:00100000:0.0:1789448283.101746:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267456 00000100:00100000:0.0:1789448283.101769:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789448283.101775:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267328:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448283.101806:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267328:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448283.101826:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789448283.101840:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1789448283.101845:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267456:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448283.101873:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295267456:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448283.101879:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1789448283.101898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295266944 00000100:00100000:0.0:1789448283.101901:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295266944 00000100:00100000:0.0:1789448283.101928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:0.0:1789448283.101935:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295266944:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448283.101961:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295266944:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448283.101968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00080000:0.0:1789448283.102006:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448283.102010:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448283.102013:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448283.289521:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448284.314650:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448285.339948:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448285.978810:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317323008:0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.978882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448285.978938:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317323520:0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.978964:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448285.978995:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448285.979001:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317323136:0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.979023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448285.979057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323008 00000100:00100000:2.0:1789448285.979064:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323008 00000100:00100000:2.0:1789448285.979111:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323136 00000100:00100000:2.0:1789448285.979115:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323136 00000100:00100000:2.0:1789448285.979147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448285.979170:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317323008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.979262:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317323008:12345-0@lo:400:kworker.0 Request processed in 82us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448285.979273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448285.979306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789448285.979312:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317323136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.979342:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317323136:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448285.979348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789448285.979368:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323520 00000100:00100000:2.0:1789448285.979371:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323520 00000100:00100000:2.0:1789448285.979400:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789448285.979407:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317323520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.979438:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317323520:12345-0@lo:400:kworker.0 Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448285.979445:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789448285.979467:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448285.979471:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448285.979507:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317323136:0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.979518:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317323008:0@lo:400:kworker.0 00010000:00080000:2.0:1789448285.979527:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d138fb80 x1876372317323520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448285.979537:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317323520:0@lo:400:kworker.0 00000100:00100000:0.0:1789448285.979700:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317322880:0@lo:400:kworker.0 00000100:00100000:0.0:1789448285.979736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448285.979776:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317323392:0@lo:400:kworker.0 00000100:00100000:0.0:1789448285.979799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448285.979814:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448285.979820:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317323264:0@lo:400:kworker.0 00000100:00100000:0.0:1789448285.979838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448285.979864:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323264 00000100:00100000:0.0:1789448285.979875:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323264 00000100:00100000:0.0:1789448285.979904:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789448285.979910:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317323264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448285.979942:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317323264:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448285.979946:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789448285.979974:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d138df80 x1876372317323264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448285.979983:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317323264:0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.983400:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317322880 00000100:00100000:2.0:1789448285.983414:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317322880 00000100:00100000:2.0:1789448285.983475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789448285.983484:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317322880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.983583:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317322880:12345-0@lo:400:kworker.0 Request processed in 100us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448285.983590:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1789448285.983628:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448285.983644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323392 00000100:00100000:2.0:1789448285.983650:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323392 00000100:00100000:2.0:1789448285.983703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789448285.983729:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317323392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448285.983773:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317323392:12345-0@lo:400:kworker.0 Request processed in 46us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448285.983779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789448285.983797:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448285.984180:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317322880:0@lo:400:kworker.0 00000100:00100000:3.0:1789448285.984196:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317323392:0@lo:400:kworker.0 00010000:00010000:2.0:1789448286.361566:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448286.489470:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317323648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448286.489547:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448286.489652:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323648 00000100:00100000:1.0:1789448286.489661:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323648 00000100:00100000:1.0:1789448286.490084:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789448286.490096:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317323648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448286.490132:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448286.490200:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317323648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448286.490207:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789448286.490326:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf15c00 x1876372317323648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448286.490344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317323648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448287.001695:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448287.001717:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317323776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448287.001784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448287.001946:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323776 00000100:00100000:2.0:1789448287.001955:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323776 00000100:00100000:2.0:1789448287.002058:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448287.002069:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317323776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448287.002104:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448287.002150:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317323776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448287.002157:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789448287.002213:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fab44000 x1876372317323776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789448287.002235:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448287.002282:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317323776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448287.385352:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448288.194734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448288.194795:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448288.194880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448288.194915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448288.194970:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268096 00000100:00100000:1.0:1789448288.194988:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268096 00000100:00100000:1.0:1789448288.195058:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789448288.195068:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295268096:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448288.195140:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295268096:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448288.195148:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:1.0:1789448288.195170:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448288.195386:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267584 00000100:00100000:0.0:1789448288.195391:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267584 00000100:00100000:0.0:1789448288.195426:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:0.0:1789448288.195433:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295267584:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448288.195463:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295267584:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448288.195469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1789448288.202717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448288.210832:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267968 00000100:00100000:1.0:1789448288.210848:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267968 00000100:00100000:1.0:1789448288.210934:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1789448288.210944:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295267968:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448288.211028:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295267968:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 85us (8320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448288.211036:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00080000:1.0:1789448288.211060:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448288.211925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267840 00000100:00100000:3.0:1789448288.211936:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267840 00000100:00100000:3.0:1789448288.211985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295267712 00000100:00100000:3.0:1789448288.211989:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295267712 00000100:00100000:3.0:1789448288.212012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1789448288.212020:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295267840:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448288.212069:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295267840:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 50us (17275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448288.212076:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1789448288.212088:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1789448288.212107:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295267712:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448288.212128:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295267712:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (17214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448288.212134:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00080000:3.0:1789448288.212155:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448288.410639:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448289.433482:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448290.462403:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448291.101184:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317323904:0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.101306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448291.101370:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317323904 00000100:00100000:2.0:1789448291.101385:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317323904 00000100:00100000:2.0:1789448291.101462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789448291.101475:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448291.101571:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317323904:12345-0@lo:400:kworker.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448291.101579:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789448291.101655:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317323904:0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.102541:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317324160:0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.102598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448291.102646:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789448291.102653:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317324032:0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.102680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448291.102701:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317324544:0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.102729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448291.102830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324160 00000100:00100000:0.0:1789448291.102838:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324160 00000100:00100000:1.0:1789448291.102942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324032 00000100:00100000:1.0:1789448291.102946:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324032 00000100:00100000:1.0:1789448291.103026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789448291.103035:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.103095:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317324032:12345-0@lo:400:kworker.0 Request processed in 60us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448291.103102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789448291.103127:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324544 00000100:00100000:1.0:1789448291.103131:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324544 00000100:00100000:1.0:1789448291.103175:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789448291.103181:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448291.103252:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317324544:12345-0@lo:400:kworker.0 Request processed in 71us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448291.103259:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789448291.103282:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448291.103316:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317324032:0@lo:400:kworker.0 00010000:00080000:1.0:1789448291.103330:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fab45880 x1876372317324544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448291.103341:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317324544:0@lo:400:kworker.0 00000100:00100000:0.0:1789448291.103459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789448291.103466:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448291.103511:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317324160:12345-0@lo:400:kworker.0 Request processed in 45us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448291.103517:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789448291.103553:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317324160:0@lo:400:kworker.0 00000100:00100000:2.0:1789448291.105543:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317324288:0@lo:400:kworker.0 00000100:00100000:2.0:1789448291.105638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448291.105687:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448291.105695:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317324416:0@lo:400:kworker.0 00000100:00100000:2.0:1789448291.105723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448291.105770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324416 00000100:00100000:2.0:1789448291.105778:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324416 00000100:00100000:2.0:1789448291.105844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448291.105854:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317324416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448291.105919:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317324416:12345-0@lo:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448291.105926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448291.105994:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317324416:0@lo:400:kworker.0 00000100:00100000:0.0:1789448291.106177:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324288 00000100:00100000:0.0:1789448291.106188:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324288 00000100:00100000:0.0:1789448291.106261:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789448291.106269:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448291.106314:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317324288:12345-0@lo:400:kworker.0 Request processed in 47us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448291.106320:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789448291.106608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448291.106614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789448291.107382:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fab45c00 x1876372317324288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448291.107400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317324288:0@lo:400:kworker.0 00010000:00010000:0.0:1789448291.485792:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448291.609972:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448291.610000:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317324672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448291.610096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448291.610251:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324672 00000100:00100000:1.0:1789448291.610261:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324672 00000100:00100000:1.0:1789448291.610318:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789448291.610327:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317324672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448291.610370:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448291.610430:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317324672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448291.610458:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789448291.610537:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf15c00 x1876372317324672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448291.610555:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317324672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448292.124866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317324800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448292.124937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448292.126095:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324800 00000100:00100000:0.0:1789448292.126108:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324800 00000100:00100000:0.0:1789448292.126183:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789448292.126202:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317324800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448292.126263:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448292.126421:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317324800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448292.126427:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789448292.126594:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fab45f80 x1876372317324800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448292.126617:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317324800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448292.510993:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448293.315035:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448293.315083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448293.315119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448293.315140:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448293.315167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448293.315243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268224 00000100:00100000:0.0:1789448293.315251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268480 00000100:00100000:3.0:1789448293.315257:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268224 00000100:00100000:0.0:1789448293.315257:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268480 00000100:00100000:0.0:1789448293.315312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268352 00000100:00100000:3.0:1789448293.315313:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1789448293.315314:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268352 00000100:00100000:3.0:1789448293.315323:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295268224:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448293.315336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1789448293.315341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295268480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448293.315413:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295268224:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 90us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448293.315421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:3.0:1789448293.315460:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268608 00000100:00100000:3.0:1789448293.315480:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268608 00000100:00100000:3.0:1789448293.315510:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268736 00000100:00100000:3.0:1789448293.315513:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268736 00000100:00100000:3.0:1789448293.315538:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789448293.315544:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2347:x1876372295268608:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:3.0:1789448293.315569:0:6671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f982f 00000100:00080000:3.0:1789448293.315580:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97d9ce9fe000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448293.315623:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789448293.317086:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1789448293.317111:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295268352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448293.320305:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295268480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 4942us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448293.320327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00080000:0.0:1789448293.320406:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448293.320414:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448293.320419:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448293.320532:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1789448293.320571:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2347:x1876372295268736:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:0.0:1789448293.320613:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9836 00000100:00080000:0.0:1789448293.320628:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d8c2304000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789448293.320688:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789448293.322445:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+2:2347:x1876372295268736:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 1865us (7288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448293.322461:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:0.0:1789448293.322508:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448293.324948:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448293.325130:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+2:2347:x1876372295268608:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 9571us (9996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448293.325146:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789448293.331847:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295268352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 14727us (16658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448293.331865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00010000:00010000:1.0:1789448293.532046:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448294.252716:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00000020:00000080:1.0:1789448294.252725:0:6696:0:(genops.c:885:class_export_put()) final put ffff97d9ce9fc000/30b293c1-5fe6-41b6-9c68-6199a552e486 00000020:00000080:2.0:1789448294.252801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9ce9fc000/30b293c1-5fe6-41b6-9c68-6199a552e486 for lustre-OST0000 00000020:00000080:2.0:1789448294.252849:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9ce9fe000 for lustre-OST0000 00010000:00010000:2.0:1789448294.561978:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448295.582242:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789448295.758186:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00000020:00000080:0.0:1789448295.758205:0:7625:0:(genops.c:885:class_export_put()) final put ffff97d8c2306800/30b293c1-5fe6-41b6-9c68-6199a552e486 00000020:00000080:0.0:1789448295.758590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c2306800/30b293c1-5fe6-41b6-9c68-6199a552e486 for lustre-OST0001 00000020:00000080:0.0:1789448295.758655:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d8c2304000 for lustre-OST0001 00000100:00100000:3.0:1789448296.221662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317325312:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.221739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.221821:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789448296.221828:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317324928:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.221859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.221882:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317325440:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.221909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448296.222044:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317324928 00000100:00100000:2.0:1789448296.222054:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317324928 00000100:00100000:2.0:1789448296.222104:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789448296.222114:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317324928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448296.222179:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317324928:12345-0@lo:400:kworker.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448296.222186:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789448296.222539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317324928:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.222566:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317325056:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.222593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.223086:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317325568:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.223138:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448296.223155:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317325184:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.223260:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325312 00000100:00100000:3.0:1789448296.223266:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325312 00000100:00100000:3.0:1789448296.223308:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325568 00000100:00100000:3.0:1789448296.223311:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325568 00000100:00100000:3.0:1789448296.223332:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789448296.223340:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317325312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223384:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317325312:12345-0@lo:400:kworker.0 Request processed in 45us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.223390:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789448296.223402:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789448296.223408:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317325568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223440:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317325568:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.223445:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789448296.223462:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325440 00000100:00100000:3.0:1789448296.223466:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325440 00000100:00100000:3.0:1789448296.223488:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325056 00000100:00100000:3.0:1789448296.223490:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325056 00000100:00100000:3.0:1789448296.223500:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325184 00000100:00100000:3.0:1789448296.223502:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325184 00000100:00100000:3.0:1789448296.223516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789448296.223522:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317325440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223552:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317325440:12345-0@lo:400:kworker.0 Request processed in 30us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.223557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789448296.223568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789448296.223580:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317325056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223610:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317325056:12345-0@lo:400:kworker.0 Request processed in 30us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.223629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789448296.223642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789448296.223648:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317325184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223675:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317325184:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.223680:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789448296.223704:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448296.223708:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448296.223711:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448296.223739:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317325184:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.223750:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317325056:0@lo:400:kworker.0 00010000:00080000:3.0:1789448296.223761:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df0000 x1876372317325568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448296.223780:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317325568:0@lo:400:kworker.0 00000100:00100000:3.0:1789448296.224722:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317325440:0@lo:400:kworker.0 00010000:00080000:3.0:1789448296.224745:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eaf17b80 x1876372317325312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448296.224756:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317325312:0@lo:400:kworker.0 00010000:00010000:1.0:1789448296.602230:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448296.729451:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448296.731682:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317325696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448296.731775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448296.732001:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325696 00000100:00100000:3.0:1789448296.732009:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325696 00000100:00100000:3.0:1789448296.732049:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789448296.732066:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317325696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448296.732100:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448296.732143:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317325696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448296.732148:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789448296.732351:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df0000 x1876372317325696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448296.732371:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317325696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448297.241548:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317325824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448297.241622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448297.241837:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325824 00000100:00100000:0.0:1789448297.241846:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325824 00000100:00100000:0.0:1789448297.241903:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789448297.241913:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317325824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448297.241953:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448297.242012:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317325824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448297.242019:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789448297.242102:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fab44700 x1876372317325824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448297.242126:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317325824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448297.628346:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448298.285628:0:11005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789448298.438087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448298.438131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448298.438263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448298.438315:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268864 00000100:00100000:1.0:1789448298.438326:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268864 00000100:00100000:1.0:1789448298.438376:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:1.0:1789448298.438386:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295268864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448298.438459:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295268864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448298.438468:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:3.0:1789448298.438945:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269120 00000100:00100000:3.0:1789448298.438951:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269120 00000100:00100000:3.0:1789448298.439008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295268992 00000100:00100000:3.0:1789448298.439012:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295268992 00000100:00100000:3.0:1789448298.439037:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1789448298.439046:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295269120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448298.439098:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295269120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 53us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448298.439104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1789448298.439117:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:3.0:1789448298.439124:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295268992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448298.439166:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295268992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448298.439173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00080000:0.0:1789448298.439284:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448298.649552:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448299.677885:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448300.697616:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448301.340789:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317326336:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.340871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.340948:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789448301.340955:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317325952:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.340988:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.341015:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317326464:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.341088:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317326208:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.341145:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789448301.341151:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317326080:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341183:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.341202:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317326592:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448301.341297:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326336 00000100:00100000:0.0:1789448301.341305:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326336 00000100:00100000:0.0:1789448301.341371:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326592 00000100:00100000:0.0:1789448301.341375:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326592 00000100:00100000:0.0:1789448301.341404:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448301.341415:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317326336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341483:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317326336:12345-0@lo:400:kworker.0 Request processed in 70us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.341492:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448301.341874:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448301.341882:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317326592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.341928:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317326592:12345-0@lo:400:kworker.0 Request processed in 47us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.341935:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448301.341965:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317325952 00000100:00100000:0.0:1789448301.341969:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317325952 00000100:00100000:0.0:1789448301.342000:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789448301.342007:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317325952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.342040:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317325952:12345-0@lo:400:kworker.0 Request processed in 34us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.342046:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789448301.342614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326464 00000100:00100000:0.0:1789448301.342620:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326464 00000100:00100000:0.0:1789448301.342658:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326208 00000100:00100000:0.0:1789448301.342661:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326208 00000100:00100000:0.0:1789448301.342677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326080 00000100:00100000:0.0:1789448301.342679:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326080 00000100:00100000:0.0:1789448301.342693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789448301.342699:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317326464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.342738:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317326464:12345-0@lo:400:kworker.0 Request processed in 39us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.342744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789448301.342757:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789448301.342903:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317326208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.342938:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317326208:12345-0@lo:400:kworker.0 Request processed in 176us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.342944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789448301.342956:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789448301.342962:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317326080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.342991:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317326080:12345-0@lo:400:kworker.0 Request processed in 30us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.343008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789448301.343041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448301.343046:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448301.343049:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448301.343743:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317326080:0@lo:400:kworker.0 00010000:00080000:0.0:1789448301.344155:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df3100 x1876372317326592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448301.344169:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317326592:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.344186:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317326208:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.344247:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317325952:0@lo:400:kworker.0 00000100:00100000:0.0:1789448301.344259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317326464:0@lo:400:kworker.0 00010000:00080000:0.0:1789448301.344616:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df3b80 x1876372317326336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448301.344627:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317326336:0@lo:400:kworker.0 00000020:00000080:0.0:1789448301.427429:0:11154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff08c61ee0 20000000:00000080:0.0:1789448301.427447:0:11154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d8c195f000 uarg=0000000000000000 20000000:01000000:0.0:1789448301.427485:0:11154:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789448301.427491:0:11154:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789448301.427496:0:11154:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789448301.428666:0:11155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789448301.428905:0:11154:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789448301.440603:0:11154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789448301.440633:0:11154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440721:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440729:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440735:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440744:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440822:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.440832:0:11154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441264:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441280:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441296:0:11154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326720:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448301.441412:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441422:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 12 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441430:0:11154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326848:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448301.441459:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441466:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441474:0:11154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326976:0@lo:104: 00000100:00100000:2.0:1789448301.441509:0:11154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448301.441545:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441552:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 18 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441571:0:11154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317327104:0@lo:104: 00000100:00100000:3.0:1789448301.441582:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317326976 00000100:00100000:3.0:1789448301.441592:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317326976 00000100:00100000:2.0:1789448301.441596:0:11154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448301.441619:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.441628:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 18 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441636:0:11154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317327232:0@lo:104: 00000100:00100000:3.0:1789448301.441640:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327104 00000100:00100000:3.0:1789448301.441644:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327104 00000100:00100000:3.0:1789448301.441660:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448301.441670:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:11154:x1876372317326976:12345-0@lo:104: 00010000:00010000:3.0:1789448301.441684:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.441741:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448301.441747:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:11154:x1876372317326976:12345-0@lo:104: Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448301.441753:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448301.441784:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448301.441789:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11154:x1876372317327104:12345-0@lo:104: 00010000:00010000:3.0:1789448301.441797:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.441840:0:11154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448301.441841:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789448301.441848:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11154:x1876372317327104:12345-0@lo:104: Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448301.441854:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448301.441855:0:11154:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448301.441869:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327232 00000100:00100000:3.0:1789448301.441874:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327232 00000100:00100000:3.0:1789448301.441889:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789448301.441894:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11154:x1876372317327232:12345-0@lo:104: 00010000:00010000:3.0:1789448301.441901:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.441944:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789448301.441950:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11154:x1876372317327232:12345-0@lo:104: Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448301.441956:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789448301.441971:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789448301.441972:0:11154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326976:0@lo:104: 00010000:00010000:3.0:1789448301.441979:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.441989:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523c00 already unused, calling callback (ffffffffc1d1cc20) 00000100:00100000:2.0:1789448301.441992:0:11154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317327104:0@lo:104: 10000000:00010000:3.0:1789448301.441995:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442004:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448301.442010:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448301.442014:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448301.442047:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442052:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448301.442086:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442093:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523c00/0xe29566c2465f97fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9805 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442129:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448301.442133:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442139:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1523000 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448301.442142:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442148:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448301.442155:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448301.442160:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448301.442174:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442179:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448301.442194:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442200:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1523000/0xe29566c2465f97f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442209:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448301.442212:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442253:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1522200 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448301.442257:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442271:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448301.442279:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.442282:0:11154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317327232:0@lo:104: 10000000:01000000:3.0:1789448301.442291:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448301.442316:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442322:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448301.442329:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442336:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1522200/0xe29566c2465f97e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f97e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.442350:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448301.442352:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448301.442354:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448301.442361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448301.442367:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448301.442377:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317327616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448301.442412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448301.442437:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448301.442451:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317327488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448301.442465:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327616 00000100:00100000:2.0:1789448301.442471:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327616 00000100:00100000:3.0:1789448301.442478:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448301.442495:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 19 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.442518:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327488 00000100:00100000:2.0:1789448301.442520:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327488 00010000:00010000:2.0:1789448301.442532:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 20 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448301.442552:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448301.442559:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789448301.442565:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317327360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448301.442568:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3307:x1876372317327616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448301.442582:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448301.442592:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 20 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.442603:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 20 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448301.442604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448301.442620:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523e00/0xe29566c2465f97e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f97e2 expref: 20 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.442634:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448301.442833:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327360 00000100:00100000:0.0:1789448301.442837:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327360 00010000:00010000:0.0:1789448301.442855:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 20 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448301.442883:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789448301.442889:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3307:x1876372317327488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448301.442898:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448301.442902:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 20 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.442910:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 20 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.442921:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523a00/0xe29566c2465f97f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f97f0 expref: 20 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.442930:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448301.442962:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317327488:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.442969:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789448301.442983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448301.442990:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3304:x1876372317327360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448301.443001:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448301.443005:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.443012:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.443021:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1523800/0xe29566c2465f9805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f97fe expref: 18 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448301.443038:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448301.443063:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3304:x1876372317327360:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448301.443069:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789448301.443255:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317327360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448301.443282:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317327488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448301.443780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317327616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448301.443847:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3307:x1876372317327616:12345-0@lo:103:ldlm_bl.0 Request processed in 1187us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448301.443856:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789448301.458471:0:11154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326720:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448301.458579:0:11154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876372317326848:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448301.458625:0:11154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448301.470011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448301.470338:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269376 00000100:00100000:2.0:1789448301.470349:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269376 00010000:00010000:2.0:1789448301.470393:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 13 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.470438:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1789448301.470448:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295269376:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448301.470464:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448301.470469:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 13 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470480:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 13 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470498:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f980c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebd5 expref: 13 pid: 5827 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470542:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448301.470602:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+12:2351:x1876372295269376:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 155us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448301.470609:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1789448301.470713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448301.470785:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269248 00000100:00100000:2.0:1789448301.470789:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269248 00010000:00010000:2.0:1789448301.470801:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448301.470821:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1789448301.470828:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+12:2351:x1876372295269248:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448301.470836:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448301.470841:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470850:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470861:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae33200/0xe29566c2465f9821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec0d expref: 12 pid: 5826 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470873:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470881:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470897:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470911:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470918:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470926:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470933:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448301.470938:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470947:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470960:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448301.470970:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448301.470992:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b086e6-5128-47e9-ae2c-494c126c747d+11:2351:x1876372295269248:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 165us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448301.470999:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00010000:00010000:3.0:1789448301.475326:0:11154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.475344:0:11154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.475352:0:11154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f983d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448301.721520:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448301.849511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448301.849534:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317327744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448301.849605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448301.849870:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327744 00000100:00100000:3.0:1789448301.849879:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327744 00000100:00100000:3.0:1789448301.849929:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789448301.849939:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317327744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448301.849979:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448301.850038:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317327744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448301.850045:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789448301.850162:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df2680 x1876372317327744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448301.850181:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317327744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448302.361538:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448302.361565:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317327872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448302.361655:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448302.362052:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317327872 00000100:00100000:3.0:1789448302.362063:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317327872 00000100:00100000:3.0:1789448302.362128:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789448302.362137:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317327872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448302.362173:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448302.362253:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317327872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448302.362260:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789448302.362395:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df2680 x1876372317327872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448302.362426:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317327872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448302.748279:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448303.362519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448303.362614:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269504 00000100:00100000:2.0:1789448303.362624:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269504 00000100:00100000:2.0:1789448303.362687:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:2.0:1789448303.362696:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+11:5591:x1876372295269504:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448303.362711:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448303.362730:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec37 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.362757:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.362768:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.362777:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2200, rc 0) 00000100:00100000:2.0:1789448303.362833:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269504:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448303.362840:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:0.0:1789448303.372130:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448303.373195:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269632 00000100:00100000:2.0:1789448303.373210:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269632 00000100:00100000:2.0:1789448303.373313:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:2.0:1789448303.373325:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269632:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448303.373618:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269632:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 296us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448303.373626:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:3.0:1789448303.389175:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448303.389954:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269760 00000100:00100000:0.0:1789448303.389967:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269760 00000100:00100000:0.0:1789448303.390030:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:0.0:1789448303.390040:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269760:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.390289:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269760:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 250us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448303.390298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:1.0:1789448303.406650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448303.406743:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295269888 00000100:00100000:2.0:1789448303.406753:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295269888 00000100:00100000:2.0:1789448303.406807:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:2.0:1789448303.406817:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295269888:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448303.406843:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448303.406859:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec3e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.406900:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.406912:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.406921:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2600, rc 0) 00000100:00100000:2.0:1789448303.406982:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295269888:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448303.406989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:1.0:1789448303.416801:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448303.416903:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270016 00000100:00100000:2.0:1789448303.416912:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270016 00000100:00100000:2.0:1789448303.416981:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:2.0:1789448303.416992:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295270016:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448303.417336:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295270016:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 344us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448303.417345:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:1.0:1789448303.420013:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448303.420480:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270144 00000100:00100000:3.0:1789448303.420490:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270144 00000100:00100000:3.0:1789448303.420531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:3.0:1789448303.420539:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295270144:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.420787:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295270144:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 247us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.420796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 10000000:01000000:2.0:1789448303.449692:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789448303.449699:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9e7a74000 from 7 10000000:01000000:2.0:1789448303.449704:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448303.449748:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.449762:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448303.449852:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448303.449879:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448303.449944:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448303.450035:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fa4ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1789448303.458451:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328000 00000100:00100000:0.0:1789448303.458466:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328000 00000100:00100000:1.0:1789448303.458895:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789448303.458906:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317328000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448303.458923:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448303.458941:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9852 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.458968:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9852 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.458979:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9852 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.458989:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58a00, rc 0) 00000100:00100000:1.0:1789448303.459074:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (9129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448303.459080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789448303.459738:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448303.459757:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.459838:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448303.459931:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.459974:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448303.460013:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448303.460103:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328128 00000100:00100000:3.0:1789448303.460109:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328128 00000100:00100000:3.0:1789448303.460149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789448303.460156:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.460403:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.460410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789448303.460437:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.460463:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.460498:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448303.460514:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1996540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448303.460523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328256 00000100:00100000:3.0:1789448303.460526:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328256 00000100:00100000:3.0:1789448303.460541:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789448303.463034:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.464046:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3494us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.464058:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789448303.465000:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789448303.469285:0:11218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789448303.475688:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789448303.475726:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448303.475737:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.475751:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448303.475832:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789448303.475835:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c336e800 from 7 10000000:01000000:1.0:1789448303.475838:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789448303.475875:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.476181:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.476193:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448303.476299:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb034000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448303.476364:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448303.476442:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448303.480615:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328384 00000100:00100000:0.0:1789448303.480629:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328384 00000100:00100000:0.0:1789448303.480684:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789448303.480694:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317328384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448303.480710:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448303.480727:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f9860 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.480752:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f9860 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.480773:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9860 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.480782:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32800, rc 0) 00000100:00100000:0.0:1789448303.480849:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448303.480856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789448303.480917:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb034000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448303.480933:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.480950:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448303.481016:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.481045:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448303.481070:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448303.481434:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328512 00000100:00100000:3.0:1789448303.481440:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328512 00000100:00100000:3.0:1789448303.481474:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789448303.481481:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.481708:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.481716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789448303.481872:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.481913:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.481948:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448303.481976:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448303.482044:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328640 00000100:00100000:3.0:1789448303.482048:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328640 00000100:00100000:3.0:1789448303.482078:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789448303.482085:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.482275:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.482281:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789448303.482317:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789448303.483390:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789448303.483462:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789448303.483478:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448303.483488:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448303.483500:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448303.483529:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448303.483532:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c6cee800 from 7 10000000:01000000:3.0:1789448303.483534:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448303.483850:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448303.483860:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448303.483869:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448303.484075:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.484198:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448303.484298:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448303.485656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328768 00000100:00100000:0.0:1789448303.485665:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328768 00000100:00100000:1.0:1789448303.487008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789448303.487019:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317328768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448303.487036:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448303.487054:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f986e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.487080:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f986e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.487102:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f986e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.487111:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59a00, rc 0) 00000100:00100000:1.0:1789448303.487203:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317328768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448303.487210:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789448303.490253:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448303.490282:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448303.490296:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448303.490362:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.490417:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448303.493266:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448303.493384:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317328896 00000100:00100000:3.0:1789448303.493394:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317328896 00000100:00100000:3.0:1789448303.493440:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789448303.493450:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317328896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448303.493750:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317328896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448303.493758:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789448303.493901:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317328896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.493949:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317329024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448303.493999:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448303.494030:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448303.494087:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329024 00000100:00100000:1.0:1789448303.494102:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329024 00000100:00100000:1.0:1789448303.494156:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789448303.494163:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317329024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448303.494435:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317329024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448303.494442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789448303.494728:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317329024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789448303.500857:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789448303.501018:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789448303.501038:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448303.501048:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448303.501060:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448303.551912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448303.551947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448303.551975:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270400 00000100:00100000:1.0:1789448303.551984:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270400 00000100:00100000:1.0:1789448303.552040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270272 00000100:00100000:1.0:1789448303.552042:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270272 00000100:00100000:1.0:1789448303.552069:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:1.0:1789448303.552078:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295270400:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448303.552159:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295270400:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448303.552177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:1.0:1789448303.552194:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:1.0:1789448303.552200:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295270272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448303.552241:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295270272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448303.552247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00080000:1.0:1789448303.552265:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448303.769387:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448304.810248:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448305.817433:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448305.931128:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789448306.457828:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317329280:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.457895:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.457954:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317329792:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.457980:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.458009:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789448306.458015:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317329152:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.458057:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317329664:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.458111:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317329408:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.458149:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448306.458154:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317329536:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458174:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448306.458241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329280 00000100:00100000:1.0:1789448306.458249:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329280 00000100:00100000:1.0:1789448306.458289:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329664 00000100:00100000:1.0:1789448306.458292:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329664 00000100:00100000:1.0:1789448306.458312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329408 00000100:00100000:1.0:1789448306.458314:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329408 00000100:00100000:1.0:1789448306.458328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789448306.458336:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317329280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448306.458377:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789448306.458384:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317329280:12345-0@lo:400:kworker.0 Request processed in 49us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448306.458384:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789448306.458409:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789448306.458414:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317329408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448306.458417:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317329664:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448306.458423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789448306.458440:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317329408:12345-0@lo:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448306.458442:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329152 00000100:00100000:1.0:1789448306.458446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789448306.458446:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329152 00000100:00100000:1.0:1789448306.458460:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329792 00000100:00100000:1.0:1789448306.458463:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329792 00000100:00100000:0.0:1789448306.458466:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789448306.458471:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317329152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458485:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329536 00000100:00100000:1.0:1789448306.458488:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329536 00000100:00100000:0.0:1789448306.458499:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317329152:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448306.458505:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789448306.458506:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789448306.458511:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458538:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317329792:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448306.458544:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789448306.458554:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789448306.458559:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458584:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317329536:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448306.458596:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789448306.458611:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448306.458615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448306.458617:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789448306.458647:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01c51880 x1876372317329536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448306.458661:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317329536:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458672:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317329408:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458800:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317329152:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458810:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317329664:0@lo:400:kworker.0 00000100:00100000:1.0:1789448306.458819:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317329280:0@lo:400:kworker.0 00010000:00080000:1.0:1789448306.458827:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01c51500 x1876372317329792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448306.458835:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317329792:0@lo:400:kworker.0 00010000:00010000:3.0:1789448306.845285:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448306.970472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448306.981576:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317329920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448306.981673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448306.982018:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317329920 00000100:00100000:3.0:1789448306.982028:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317329920 00000100:00100000:3.0:1789448306.982109:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789448306.982135:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317329920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448306.982190:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448306.982275:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317329920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448306.982282:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789448306.983555:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df0e00 x1876372317329920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448306.983581:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317329920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448307.481595:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448307.481618:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317330048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448307.481685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448307.481801:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330048 00000100:00100000:1.0:1789448307.481810:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330048 00000100:00100000:1.0:1789448307.481861:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789448307.481870:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317330048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448307.481905:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448307.481953:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317330048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448307.481959:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789448307.482046:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb0b0380 x1876372317330048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448307.482074:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317330048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448307.865425:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448308.671154:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448308.671280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448308.671312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448308.671445:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270528 00000100:00100000:2.0:1789448308.671455:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270528 00000100:00100000:2.0:1789448308.671501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:2.0:1789448308.671511:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295270528:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448308.671577:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295270528:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448308.671584:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:0.0:1789448308.671727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270656 00000100:00100000:0.0:1789448308.671731:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270656 00000100:00100000:0.0:1789448308.671775:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270784 00000100:00100000:0.0:1789448308.671779:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270784 00000100:00100000:0.0:1789448308.671803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1789448308.671809:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295270656:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448308.671840:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295270656:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448308.671854:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1789448308.671868:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:0.0:1789448308.671874:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295270784:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448308.671898:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295270784:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448308.671904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00080000:2.0:1789448308.671958:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448308.889817:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448309.913988:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448310.848013:0:11452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:58:28 (1789448308) === 00010000:00010000:1.0:1789448310.946070:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448311.174494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.174642:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295270912 00000100:00100000:1.0:1789448311.174657:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295270912 00000100:00080000:2.0:1789448311.174878:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448311.174989:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789448311.175001:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295270912:12345-192.168.202.54@tcp:41:mkdir.0 00000004:00000024:1.0:1789448311.175057:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789448311.175159:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295270912:12345-192.168.202.54@tcp:41:mkdir.0 Request processed in 160us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.175167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789448311.178435:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.178551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271040 00000100:00100000:3.0:1789448311.178560:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271040 00000100:00100000:3.0:1789448311.178615:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789448311.178635:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9689:x1876372295271040:12345-192.168.202.54@tcp:700:mkdir.0 00000100:00100000:3.0:1789448311.178719:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9689:x1876372295271040:12345-192.168.202.54@tcp:700:mkdir.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448311.178726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789448311.183360:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.183511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271296 00000100:00100000:3.0:1789448311.183521:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271296 00000100:00100000:3.0:1789448311.183580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789448311.183590:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9689:x1876372295271296:12345-192.168.202.54@tcp:36:mkdir.0 00010000:00010000:3.0:1789448311.183655:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448311.183959:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f975d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc0 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.183979:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448311.183991:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448311.184386:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.184409:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.184420:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.184433:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.184441:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.184447:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448311.186842:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789448311.186860:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186870:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186878:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186884:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448311.186890:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186897:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186924:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448311.186927:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448311.186933:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.186939:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f987c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789448311.186958:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ee2bd6c reply state 00000000156b705f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448311.186967:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789448311.187710:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9689:x1876372295271296:12345-192.168.202.54@tcp:36:mkdir.0 Request processed in 4116us (4354us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789448311.187721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:0.0:1789448311.193353:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193376:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193384:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193391:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.193396:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193404:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193421:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97d9d0a5c800) 00010000:00010000:0.0:1789448311.193424:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448311.193429:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.193436:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465f9883 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448311.217183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.217346:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271424 00000100:00100000:0.0:1789448311.217358:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271424 00000100:00100000:0.0:1789448311.217409:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789448311.217419:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9691:x1876372295271424:12345-192.168.202.54@tcp:101:chmod.0 00010000:00010000:0.0:1789448311.217443:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448311.217469:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f988a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec45 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217536:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217550:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217562:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448311.217600:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448311.217604:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448311.217654:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217688:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f988a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec45 expref: 8 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217707:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec45 expref: 7 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.217715:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:0.0:1789448311.217727:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448311.217731:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33800, rc 0) 00000100:00100000:0.0:1789448311.217789:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9691:x1876372295271424:12345-192.168.202.54@tcp:101:chmod.0 Request processed in 372us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448311.217796:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789448311.231505:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.231817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271680 00000100:00100000:1.0:1789448311.231835:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271680 00000100:00100000:1.0:1789448311.231908:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1789448311.231919:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9691:x1876372295271680:12345-192.168.202.54@tcp:36:chmod.0 00010000:00010000:1.0:1789448311.231969:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448311.231995:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec45 expref: 7 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.232016:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:1.0:1789448311.232042:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448311.232074:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.232088:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.232100:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448311.232422:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b00e186 reply state 0000000097d75ed8 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448311.232431:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789448311.232439:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789448311.232530:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:9691:x1876372295271680:12345-192.168.202.54@tcp:36:chmod.0 Request processed in 612us (1040us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789448311.232537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00010000:00010000:3.0:1789448311.241679:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241704:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241715:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241723:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448311.241729:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241750:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241804:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6a00) 00010000:00010000:3.0:1789448311.241807:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789448311.241815:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.241823:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9898 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.257872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.257959:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271808 00000100:00100000:2.0:1789448311.257984:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271808 00000100:00100000:2.0:1789448311.258099:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789448311.258113:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9692:x1876372295271808:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:2.0:1789448311.258148:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448311.258189:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f989f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec4c expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258339:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258361:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258379:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448311.258438:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789448311.258444:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448311.258495:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258529:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f989f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec4c expref: 9 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258551:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec4c expref: 8 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.258578:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:2.0:1789448311.258582:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448311.258587:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3800, rc 0) 00000100:00100000:2.0:1789448311.258681:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:9692:x1876372295271808:12345-192.168.202.54@tcp:101:chown.0 Request processed in 571us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.258688:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789448311.261006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.261170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295271936 00000100:00100000:1.0:1789448311.261183:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295271936 00000100:00100000:1.0:1789448311.262122:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789448311.262141:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:9692:x1876372295271936:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:1.0:1789448311.262172:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448311.262204:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f98ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262352:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262370:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262385:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262406:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262414:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262441:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262566:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262575:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262583:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448311.262625:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789448311.262630:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448311.262659:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262674:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262682:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262690:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262697:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448311.262703:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262713:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262736:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:1.0:1789448311.262739:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448311.262747:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262754:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f98b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262772:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262778:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262784:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262790:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448311.262793:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262800:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262808:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448311.262810:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448311.262814:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262820:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f98bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262874:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f98ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec53 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262893:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec53 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.262901:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9e0bd6100) 00010000:00010000:1.0:1789448311.262904:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448311.262906:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59400, rc 0) 00000100:00100000:1.0:1789448311.262988:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:9692:x1876372295271936:12345-192.168.202.54@tcp:101:chown.0 Request processed in 855us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.262996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1789448311.267557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.267627:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295272192 00000100:00100000:2.0:1789448311.267643:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295272192 00000100:00100000:2.0:1789448311.267725:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1789448311.267738:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+9:9692:x1876372295272192:12345-192.168.202.54@tcp:36:chown.0 00010000:00010000:2.0:1789448311.267815:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448311.267851:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59400/0xe29566c2465f98c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec53 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.267876:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9e0bd6100) 00010000:00010000:2.0:1789448311.267892:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448311.267927:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.267943:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.267956:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448311.319584:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1789448311.319617:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1789448311.319695:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096973751 reply state 0000000084248476 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448311.319709:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789448311.319728:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1789448311.319881:0:7825:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789448311.319901:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9692:x1876372295272192:12345-192.168.202.54@tcp:36:chown.0 Request processed in 52162us (52357us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789448311.319910:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:1.0:1789448311.319950:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.319956:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.319963:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.319974:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448311.319978:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.319985:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.320000:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448311.320003:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789448311.320008:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.320012:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f98c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.335636:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.335733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295272320 00000100:00100000:3.0:1789448311.335743:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295272320 00000100:00100000:3.0:1789448311.335803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1789448311.335813:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9693:x1876372295272320:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:3.0:1789448311.335841:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448311.335868:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f98d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec5a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789448311.341356:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5372us 00010000:00010000:2.0:1789448311.397187:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397251:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397269:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397292:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397300:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397308:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397741:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397749:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397755:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448311.397781:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789448311.397786:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448311.397836:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397851:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397865:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397872:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397879:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448311.397885:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397892:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397906:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:2.0:1789448311.397909:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448311.397915:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397922:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f98d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397939:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397945:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397952:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397957:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448311.397966:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397973:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397982:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97d9d6311900) 00010000:00010000:2.0:1789448311.397985:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448311.397987:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.397994:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f98de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.398053:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465f98d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec5a expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.398072:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec5a expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.398081:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:2.0:1789448311.398083:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789448311.398086:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3400, rc 0) 00000100:00100000:2.0:1789448311.398191:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9693:x1876372295272320:12345-192.168.202.54@tcp:101:touch.500 Request processed in 62377us (62563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.398203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789448311.403562:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.404114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295272576 00000100:00100000:2.0:1789448311.404319:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295272576 00000100:00100000:2.0:1789448311.404417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789448311.404431:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9693:x1876372295272576:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:2.0:1789448311.404485:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448311.404518:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f98ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec61 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.407097:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.408639:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.408988:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.415497:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.415533:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.415550:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789448311.416681:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789448311.416991:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417008:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417029:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417091:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417112:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417119:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417127:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.417133:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417142:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417158:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:0.0:1789448311.417161:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448311.417167:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2e00/0xe29566c2465f98f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448311.417191:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000240d616f reply state 0000000015a73405 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.417202:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789448311.417289:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f98ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec61 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417311:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec61 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.417329:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:0.0:1789448311.417332:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448311.417335:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448311.417454:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+10:9693:x1876372295272576:12345-192.168.202.54@tcp:101:touch.500 Request processed in 13026us (13908us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789448311.417464:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00010000:00010000:1.0:1789448311.433384:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433402:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433410:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433415:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448311.433420:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433428:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433463:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff97d9d0030a00) 00010000:00010000:1.0:1789448311.433467:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448311.433473:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.433479:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f98fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.444061:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.444393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295272832 00000100:00100000:1.0:1789448311.444405:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295272832 00000100:00100000:1.0:1789448311.444465:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448311.444475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:9693:x1876372295272832:12345-192.168.202.54@tcp:36:touch.500 00010000:00010000:1.0:1789448311.444539:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448311.444570:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec61 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.444591:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:1.0:1789448311.444603:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448311.444656:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.444672:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.444683:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448311.444833:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009553a294 reply state 000000008fc9c7ec transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448311.444860:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448311.444953:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+10:9693:x1876372295272832:12345-192.168.202.54@tcp:36:touch.500 Request processed in 478us (901us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789448311.444961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00010000:00010000:1.0:1789448311.446779:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446795:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446803:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446809:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448311.446814:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446822:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446837:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448311.446840:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448311.446845:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.446851:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58200/0xe29566c2465f990f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.449513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.450346:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295272960 00000100:00100000:3.0:1789448311.450365:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295272960 00000100:00100000:3.0:1789448311.450455:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1789448311.450467:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+9:9693:x1876372295272960:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:3.0:1789448311.450563:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448311.450597:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465f9916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec68 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.450799:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465f9916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec68 expref: 10 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.450841:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465f9916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec68 expref: 10 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.450865:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:3.0:1789448311.450869:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448311.450874:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27e00, rc 0) 00000100:00100000:3.0:1789448311.451186:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:9693:x1876372295272960:12345-192.168.202.54@tcp:101:touch.500 Request processed in 576us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448311.451198:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1789448311.454143:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.455863:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273088 00000100:00100000:1.0:1789448311.455879:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273088 00000100:00100000:1.0:1789448311.455941:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789448311.455950:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876372295273088:12345-192.168.202.54@tcp:8:touch.500 00010000:00080000:1.0:1789448311.455984:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:1.0:1789448311.456039:0:6672:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f991d 00002000:00100000:1.0:1789448311.456051:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7263448-abed-44d6-a5e0-4aa81ee22270/ffff97d8c2303800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448311.456075:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789448311.456334:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448311.456368:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d8c2305800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448311.456444:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295273088:12345-192.168.202.54@tcp:8:touch.500 Request processed in 493us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.456452:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789448311.471400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448311.471509:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273216 00000100:00100000:1.0:1789448311.471519:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273216 00000100:00100000:1.0:1789448311.471636:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1789448311.471645:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:0:x1876372295273216:12345-192.168.202.54@tcp:2:touch.500 00000100:00080000:2.0:1789448311.475723:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789448311.501258:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789448311.501274:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000100:00100000:0.0:1789448311.501645:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:0:x1876372295273216:12345-192.168.202.54@tcp:2:touch.500 Request processed in 29995us (30249us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789448311.501657:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1789448311.513516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.513782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273472 00000100:00100000:2.0:1789448311.513792:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273472 00000100:00100000:2.0:1789448311.513845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:2.0:1789448311.513856:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+10:9693:x1876372295273472:12345-192.168.202.54@tcp:35:touch.500 00000100:00100000:2.0:1789448311.514202:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+11:9693:x1876372295273472:12345-192.168.202.54@tcp:35:touch.500 Request processed in 347us (694us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789448311.514211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789448311.534850:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.534959:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273600 00000100:00100000:0.0:1789448311.534970:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273600 00000100:00100000:0.0:1789448311.535037:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1789448311.535056:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+11:9694:x1876372295273600:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:0.0:1789448311.535085:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448311.535107:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535175:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535189:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535252:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448311.535288:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448311.535293:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448311.535332:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535360:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec6f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535378:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec6f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.535385:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:0.0:1789448311.535388:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448311.535391:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448311.535452:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+12:9694:x1876372295273600:12345-192.168.202.54@tcp:101:rm.0 Request processed in 398us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448311.535460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789448311.544920:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.546189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273856 00000100:00100000:0.0:1789448311.546203:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273856 00000100:00100000:0.0:1789448311.546342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:0.0:1789448311.546355:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+12:9694:x1876372295273856:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:0.0:1789448311.546376:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448311.546402:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec76 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448311.546529:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789448311.546656:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec76 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.546670:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:0.0:1789448311.546674:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448311.546679:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec76 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.546694:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33200, rc 0) 00000100:00100000:0.0:1789448311.546767:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:9694:x1876372295273856:12345-192.168.202.54@tcp:101:rm.0 Request processed in 414us (1854us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789448311.546774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1789448311.550008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.550335:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295273984 00000100:00100000:2.0:1789448311.550348:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295273984 00000100:00100000:2.0:1789448311.550411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789448311.550423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+13:9694:x1876372295273984:12345-192.168.202.54@tcp:37:rm.0 00000100:00100000:2.0:1789448311.557855:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+13:9694:x1876372295273984:12345-192.168.202.54@tcp:37:rm.0 Request processed in 7422us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.557878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789448311.564120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.564323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295274240 00000100:00100000:3.0:1789448311.564333:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295274240 00000100:00100000:2.0:1789448311.564463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:2.0:1789448311.564474:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:9694:x1876372295274240:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:2.0:1789448311.564774:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:9694:x1876372295274240:12345-192.168.202.54@tcp:35:rm.0 Request processed in 301us (664us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789448311.564783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789448311.567308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.567402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295274496 00000100:00100000:0.0:1789448311.567413:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295274496 00000100:00100000:0.0:1789448311.567525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:0.0:1789448311.567547:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+14:9694:x1876372295274496:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:0.0:1789448311.567576:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448311.567601:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.567705:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9947 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.567721:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9947 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.567751:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9947 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448311.567765:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789448311.567928:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec7d expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.567945:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9947 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec7d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.567952:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:0.0:1789448311.567955:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789448311.567959:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32000, rc 0) 00000100:00100000:0.0:1789448311.568030:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295274496:12345-192.168.202.54@tcp:101:rm.0 Request processed in 486us (731us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789448311.568036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789448311.575087:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448311.575168:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295274624 00000100:00100000:3.0:1789448311.575177:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295274624 00000100:00100000:0.0:1789448311.575289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1789448311.575303:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295274624:12345-192.168.202.54@tcp:41:rm.0 00000004:00000024:0.0:1789448311.575369:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789448311.575433:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295274624:12345-192.168.202.54@tcp:41:rm.0 Request processed in 133us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448311.575440:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789448311.577565:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317330560:0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.577637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448311.577718:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448311.577725:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317330432:0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.577752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448311.577785:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330560 00000100:00100000:1.0:1789448311.577805:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330560 00000100:00100000:1.0:1789448311.577859:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789448311.577867:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.577933:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317330560:12345-0@lo:400:kworker.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.577940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789448311.577959:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448311.577974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330432 00000100:00100000:1.0:1789448311.577977:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330432 00000100:00100000:1.0:1789448311.578007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789448311.578014:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317330432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.578083:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317330432:12345-0@lo:400:kworker.0 Request processed in 69us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.578089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789448311.578104:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448311.578133:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317330432:0@lo:400:kworker.0 00010000:00080000:1.0:1789448311.578145:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01c51c00 x1876372317330560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448311.578156:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317330560:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578184:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317330176:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448311.578274:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317330688:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448311.578317:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789448311.578323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317330304:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448311.578360:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317330816:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448311.578407:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330688 00000100:00100000:2.0:1789448311.578411:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330688 00000100:00100000:2.0:1789448311.578435:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330304 00000100:00100000:2.0:1789448311.578438:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330304 00000100:00100000:2.0:1789448311.578453:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789448311.578459:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317330688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578507:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317330688:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.578513:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789448311.578536:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789448311.578541:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317330304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578570:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317330304:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.578575:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789448311.578611:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317330304:0@lo:400:kworker.0 00000100:00100000:2.0:1789448311.578623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317330688:0@lo:400:kworker.0 00000100:00100000:0.0:1789448311.579085:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330816 00000100:00100000:0.0:1789448311.579091:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330816 00000100:00100000:0.0:1789448311.579134:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789448311.579142:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317330816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448311.579202:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317330816:12345-0@lo:400:kworker.0 Request processed in 61us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448311.579209:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789448311.579317:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fb008380 x1876372317330816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448311.579340:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317330816:0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.579577:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330176 00000100:00100000:1.0:1789448311.579581:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330176 00000100:00100000:1.0:1789448311.579624:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789448311.579631:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.579680:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317330176:12345-0@lo:400:kworker.0 Request processed in 49us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448311.579687:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:1.0:1789448311.579722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448311.579726:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448311.579795:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317330176:0@lo:400:kworker.0 00000100:00100000:1.0:1789448311.587360:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.591736:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295274752 00000100:00100000:2.0:1789448311.591752:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295274752 00000100:00100000:2.0:1789448311.591981:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1789448311.591994:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295274752:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1789448311.592027:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448311.592060:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec84 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592129:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592144:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592157:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592173:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592181:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592204:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592354:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592363:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592371:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448311.592398:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789448311.592402:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448311.592419:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592431:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592438:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592444:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592451:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592457:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448311.592461:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592488:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592501:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:2.0:1789448311.592504:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448311.592509:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592515:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f995c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592530:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592536:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592542:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592547:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448311.592550:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592555:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592562:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff97d9d6311900) 00010000:00010000:2.0:1789448311.592564:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448311.592567:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592582:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592630:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec84 expref: 18 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592643:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec84 expref: 17 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.592651:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:2.0:1789448311.592653:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448311.592656:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448311.592898:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+17:9694:x1876372295274752:12345-192.168.202.54@tcp:101:rm.0 Request processed in 905us (5548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448311.592906:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789448311.601846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448311.601954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275008 00000100:00100000:2.0:1789448311.601964:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275008 00000100:00100000:2.0:1789448311.602037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1789448311.602149:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+17:9694:x1876372295275008:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1789448311.602204:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789448311.602266:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f996a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec84 expref: 17 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465f9916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec68 expref: 16 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602326:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:2.0:1789448311.602343:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f992b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec6f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602351:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:2.0:1789448311.602355:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448311.602374:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602388:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602397:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602411:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602418:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602424:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602540:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602549:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448311.602566:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448311.605104:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789448311.605125:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333307906569ns, next at 334307902579ns, rc = 0 00010000:00010000:0.0:1789448311.605207:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605312:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605325:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605335:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605341:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605347:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605430:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448311.605452:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605459:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605465:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605566:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.605571:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605579:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605660:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:0.0:1789448311.605665:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789448311.605671:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605677:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3c00/0xe29566c2465f997f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605701:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605708:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605714:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605719:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.605722:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605727:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:0.0:1789448311.605749:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448311.605753:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.605759:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2000/0xe29566c2465f9971 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448311.605774:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005725b1c6 reply state 0000000092315747 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.605783:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448311.606481:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295275008:12345-192.168.202.54@tcp:36:rm.0 Request processed in 4419us (4628us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789448311.606493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00010000:00010000:1.0:1789448311.606680:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448311.606688:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.606695:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448311.606699:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.606706:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.606717:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:1.0:1789448311.606719:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789448311.606723:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.606728:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9986 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448311.606747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448311.606749:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448311.606750:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448311.612169:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612187:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612195:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612202:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.612207:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612239:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612277:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff97d9d6311900) 00010000:00010000:0.0:1789448311.612280:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448311.612286:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.612292:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3600/0xe29566c2465f9978 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448311.614422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.614510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275264 00000100:00100000:0.0:1789448311.614520:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275264 00000100:00100000:0.0:1789448311.614575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789448311.614586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+15:9694:x1876372295275264:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:0.0:1789448311.614833:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295275264:12345-192.168.202.54@tcp:35:rm.0 Request processed in 249us (419us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789448311.614842:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789448311.618803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448311.619070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275520 00000100:00100000:0.0:1789448311.619080:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275520 00000100:00100000:0.0:1789448311.619144:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:0.0:1789448311.619156:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+16:9694:x1876372295275520:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:0.0:1789448311.619248:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789448311.619275:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec7d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619297:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f98e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec5a expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619310:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d6311d00) 00010000:00010000:0.0:1789448311.619341:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f98a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec4c expref: 14 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619349:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:0.0:1789448311.619355:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448311.619379:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619392:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619403:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619416:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619423:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619430:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619702:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619711:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.619718:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448311.620537:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789448311.620561:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620570:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620577:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620584:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.620589:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620597:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620608:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448311.620623:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789448311.620628:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f999b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620655:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620661:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620667:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620672:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448311.620682:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620689:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620697:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030300) 00010000:00010000:0.0:1789448311.620700:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448311.620702:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448311.620708:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f998d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448311.620720:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b12716b1 reply state 0000000085f0cc23 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448311.620729:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448311.620818:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:9694:x1876372295275520:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1662us (2022us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789448311.620827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00010000:00010000:3.0:1789448311.632611:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632636:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632645:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632678:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448311.632685:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632695:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632719:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97d9d0030900) 00010000:00010000:3.0:1789448311.632723:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448311.632729:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.632737:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9994 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448311.961488:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448312.090972:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448312.090996:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317330944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448312.091083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448312.091314:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317330944 00000100:00100000:3.0:1789448312.091324:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317330944 00000100:00100000:3.0:1789448312.091381:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789448312.091391:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317330944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448312.091415:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448312.091473:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317330944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448312.091480:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789448312.091591:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9f4df0700 x1876372317330944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448312.091622:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317330944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448312.602156:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317331072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448312.602263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448312.603486:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331072 00000100:00100000:3.0:1789448312.603500:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331072 00000100:00100000:3.0:1789448312.603567:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448312.603578:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317331072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448312.603643:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448312.603731:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317331072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448312.603740:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789448312.603810:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce827800 x1876372317331072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448312.603834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317331072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448312.988802:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448313.795416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448313.795469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448313.795503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275648 00000100:00100000:1.0:1789448313.795513:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275648 00000100:00100000:1.0:1789448313.796389:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1789448313.796401:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295275648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448313.796474:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295275648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 75us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448313.796482:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1789448313.796719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275776 00000100:00100000:1.0:1789448313.796726:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275776 00000100:00100000:1.0:1789448313.796772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:1.0:1789448313.796781:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2349:x1876372295275776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448313.796821:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2349:x1876372295275776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448313.796828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00080000:1.0:1789448313.796975:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448313.798738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448313.798782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448313.798810:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295275904 00000100:00100000:1.0:1789448313.798826:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295275904 00000100:00100000:1.0:1789448313.798878:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1789448313.798889:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295275904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448313.798956:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295275904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448313.798963:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00080000:1.0:1789448313.798990:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448313.799250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276032 00000100:00100000:0.0:1789448313.799257:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276032 00000100:00100000:0.0:1789448313.799302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1789448313.799309:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295276032:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448313.799492:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295276032:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 182us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448313.799499:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00080000:1.0:1789448313.799695:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448314.018438:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448315.033802:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448315.563842:0:11607:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789448316.057673:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789448316.664551:0:11655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd856037c0 20000000:00000080:1.0:1789448316.664568:0:11655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d9fffb3800 uarg=0000000000000000 20000000:01000000:1.0:1789448316.664602:0:11655:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789448316.664608:0:11655:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789448316.664613:0:11655:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789448316.665527:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789448316.665685:0:11655:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789448316.671142:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789448316.671190:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789448316.671291:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789448316.671312:0:11655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789448316.671332:0:11655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671354:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671362:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671370:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9852 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671390:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f9860 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671398:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f986e expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671405:0:11655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671909:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.671927:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 18 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.671941:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331200:0@lo:104: 00000100:00100000:1.0:1789448316.672020:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448316.672084:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.672093:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 18 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.672101:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331328:0@lo:104: 00000100:00100000:1.0:1789448316.672118:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448316.672189:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.672197:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 18 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.672247:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331456:0@lo:104: 00000100:00100000:1.0:1789448316.672274:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448316.672959:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.672984:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 12 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.673054:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331584:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448316.673170:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.673180:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 12 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.673188:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331712:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448316.673212:0:11655:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448316.673288:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789448316.673302:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331200 00000100:00100000:3.0:1789448316.673310:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331200 00000100:00100000:3.0:1789448316.673347:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331328 00000100:00100000:3.0:1789448316.673351:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331328 00000100:00100000:3.0:1789448316.673360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331456 00000100:00100000:3.0:1789448316.673362:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331456 00000100:00100000:3.0:1789448316.673374:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789448316.673394:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:11655:x1876372317331200:12345-0@lo:104: 00010000:00010000:3.0:1789448316.673409:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673603:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448316.673609:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+5:11655:x1876372317331200:12345-0@lo:104: Request processed in 227us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.673617:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789448316.673639:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448316.673646:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:11655:x1876372317331328:12345-0@lo:104: 00010000:00010000:3.0:1789448316.673654:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673687:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789448316.673693:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+4:11655:x1876372317331328:12345-0@lo:104: Request processed in 48us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.673710:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448316.673724:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448316.673730:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11655:x1876372317331456:12345-0@lo:104: 00010000:00010000:3.0:1789448316.673748:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673783:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789448316.673788:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+3:11655:x1876372317331456:12345-0@lo:104: Request processed in 59us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.673793:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789448316.673830:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789448316.673836:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673844:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448316.673848:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673857:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448316.673864:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448316.673870:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448316.673895:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673900:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448316.673924:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673931:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465f986e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9875 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673943:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448316.673946:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673951:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448316.673954:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.673961:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448316.673981:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448316.673987:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789448316.674146:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331200:0@lo:104: 00000100:00100000:1.0:1789448316.674155:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331328:0@lo:104: 00000100:00100000:1.0:1789448316.674161:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331456:0@lo:104: 00010000:00010000:3.0:1789448316.674198:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674204:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448316.674211:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674295:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae58600/0xe29566c2465f9860 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674307:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448316.674317:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674324:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448316.674327:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674334:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448316.674340:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448316.674345:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448316.674563:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674570:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448316.674593:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674600:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465f9852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465f9859 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674616:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448316.674618:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448316.674619:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448316.674625:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448316.674630:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448316.674641:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317331840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448316.674677:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448316.674720:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448316.674727:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317331968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448316.674762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448316.674786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448316.674793:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317332096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448316.674815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448316.674841:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331840 00000100:00100000:3.0:1789448316.674846:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331840 00010000:00010000:3.0:1789448316.674868:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 19 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448316.674889:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317331968 00000100:00100000:3.0:1789448316.674892:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317331968 00010000:00010000:3.0:1789448316.674904:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 20 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448316.674913:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332096 00000100:00100000:3.0:1789448316.674915:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332096 00010000:00010000:3.0:1789448316.674923:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 21 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448316.674934:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448316.674940:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+21:3306:x1876372317331840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448316.674951:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448316.674957:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 21 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674967:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 21 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.674989:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59a00/0xe29566c2465f9875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f986e expref: 21 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676369:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448316.676544:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+20:3306:x1876372317331840:12345-0@lo:103:ldlm_bl.0 Request processed in 1601us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.676555:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448316.676588:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448316.676598:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317331968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448316.676612:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448316.676619:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 19 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676631:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 19 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676647:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32800/0xe29566c2465f9867 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9860 expref: 19 pid: 5828 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676656:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448316.676681:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3306:x1876372317331968:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.676688:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448316.676701:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789448316.676708:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3305:x1876372317332096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448316.676715:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448316.676720:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 17 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676728:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 17 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676748:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58a00/0xe29566c2465f9859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465f9852 expref: 17 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.676758:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448316.676799:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3305:x1876372317332096:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.676805:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789448316.676891:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317332096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448316.676925:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317331968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448316.676933:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317331840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448316.682026:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448316.682053:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448316.682124:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276160 00000100:00100000:3.0:1789448316.682133:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276160 00010000:00010000:3.0:1789448316.682167:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 13 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448316.682201:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276288 00000100:00100000:3.0:1789448316.682204:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276288 00010000:00010000:3.0:1789448316.682213:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 14 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448316.682257:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789448316.682266:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b086e6-5128-47e9-ae2c-494c126c747d+14:2351:x1876372295276160:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448316.682279:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448316.682284:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 14 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682308:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 14 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682327:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448316.682371:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b086e6-5128-47e9-ae2c-494c126c747d+14:2351:x1876372295276160:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.682390:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789448316.682406:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1789448316.682411:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295276288:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448316.682419:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448316.682423:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 13 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682432:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 13 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682444:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682452:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682466:0:7613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682474:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682482:0:7613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682494:0:7613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682501:0:7613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448316.682505:0:7613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682513:0:7613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682521:0:7613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448316.682530:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448316.682546:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295276288:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 134us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448316.682552:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00010000:00010000:1.0:1789448316.683129:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2600/0xe29566c2465f984b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec3e expref: 12 pid: 5827 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.683145:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331584:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448316.683161:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f9844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec37 expref: 11 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448316.683186:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1876372317331712:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448316.683240:0:11655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.683250:0:11655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.683256:0:11655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.683263:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448316.701486:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317332608:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701553:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.701593:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789448316.701600:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317332224:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.701640:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317332736:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701662:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.701691:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332736 00000100:00100000:0.0:1789448316.701698:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332736 00000100:00100000:0.0:1789448316.701771:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789448316.701780:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317332736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701837:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317332736:12345-0@lo:400:kworker.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448316.701844:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789448316.701869:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317332480:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701893:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.701912:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448316.701917:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317332352:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.701937:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.701962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332608 00000100:00100000:0.0:1789448316.701966:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332608 00000100:00100000:0.0:1789448316.702002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332224 00000100:00100000:0.0:1789448316.702005:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332224 00000100:00100000:0.0:1789448316.702015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332352 00000100:00100000:0.0:1789448316.702018:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332352 00000100:00100000:0.0:1789448316.702032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789448316.702038:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317332608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.702087:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317332608:12345-0@lo:400:kworker.0 Request processed in 48us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448316.702093:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789448316.702105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789448316.702110:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.702136:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317332224:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448316.702141:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789448316.702154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789448316.702159:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317332352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.702186:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317332352:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448316.702192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789448316.702509:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317332352:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.702550:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317332224:0@lo:400:kworker.0 00010000:00080000:0.0:1789448316.702562:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01eb4a80 x1876372317332736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448316.702572:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317332736:0@lo:400:kworker.0 00000100:00100000:0.0:1789448316.702580:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317332608:0@lo:400:kworker.0 00000100:00080000:1.0:1789448316.702773:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448316.702779:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448316.702789:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332480 00000100:00100000:1.0:1789448316.702794:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332480 00000100:00100000:1.0:1789448316.702827:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448316.702834:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317332480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448316.702878:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317332480:12345-0@lo:400:kworker.0 Request processed in 44us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448316.702884:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789448316.702901:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789448316.702920:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01eb5180 x1876372317332480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448316.702929:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317332480:0@lo:400:kworker.0 00000001:00080000:2.0:1789448316.773745:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789448316.773768:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789448316.773999:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317332864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789448316.774072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448316.777304:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332864 00000100:00100000:0.0:1789448316.777317:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332864 00000100:00100000:0.0:1789448316.777374:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448316.777385:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317332864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789448316.777430:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789448316.777467:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa8d077, atime: 0x6aa8d077, ctime: 0x6aa8d077, blocks: 0x1 00010000:00010000:0.0:1789448316.777476:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448316.777493:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1789448316.777497:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448316.777502:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448316.777519:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448316.777529:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448316.777537:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448316.777553:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448316.778029:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448316.778044:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.778052:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448316.778057:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.778067:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.778086:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.778095:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465f99a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448316.778115:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448316.778117:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448316.778118:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448316.778463:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317332864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1078us (4389us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789448316.778471:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789448316.780360:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9f4df0380/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789448316.780373:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317332864:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789448317.084683:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448317.213178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448317.213202:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317332992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448317.213294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448317.213493:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317332992 00000100:00100000:2.0:1789448317.213501:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317332992 00000100:00100000:2.0:1789448317.213557:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789448317.213567:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317332992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448317.213602:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448317.213666:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317332992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448317.213674:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789448317.213919:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317332992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448317.724377:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317333120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448317.724448:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448317.724713:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333120 00000100:00100000:2.0:1789448317.724721:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333120 00000100:00100000:2.0:1789448317.724776:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789448317.724784:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317333120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448317.724817:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448317.724866:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317333120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448317.724885:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789448317.725191:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce824700 x1876372317333120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448317.725209:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317333120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448318.105499:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448318.336695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.336858:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276416 00000100:00100000:2.0:1789448318.336868:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276416 00000100:00100000:2.0:1789448318.336930:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:2.0:1789448318.336941:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+11:5591:x1876372295276416:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448318.336968:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448318.337002:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc3600/0xe29566c2465f99b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec8b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.337031:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc3600/0xe29566c2465f99b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec8b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.337042:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc3600/0xe29566c2465f99b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec8b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.337052:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3600, rc 0) 00000100:00100000:2.0:1789448318.337106:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295276416:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 168us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.337113:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:3.0:1789448318.339617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448318.341307:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276544 00000100:00100000:1.0:1789448318.341320:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276544 00000100:00100000:1.0:1789448318.341445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:1.0:1789448318.341470:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295276544:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.341783:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295276544:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 314us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.341791:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:0.0:1789448318.344558:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448318.344758:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276672 00000100:00100000:1.0:1789448318.344768:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276672 00000100:00100000:1.0:1789448318.344821:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:1.0:1789448318.344831:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295276672:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.345438:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9cea42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295276672:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 607us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.345447:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:0.0:1789448318.349336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448318.349498:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276800 00000100:00100000:1.0:1789448318.349510:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276800 00000100:00100000:1.0:1789448318.349575:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:1.0:1789448318.349586:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:9965:x1876372295276800:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448318.350168:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:9965:x1876372295276800:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 582us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.350177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:3.0:1789448318.358564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.358772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295276928 00000100:00100000:2.0:1789448318.358783:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295276928 00000100:00100000:2.0:1789448318.358846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:2.0:1789448318.358856:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:9965:x1876372295276928:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448318.359380:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+12:9965:x1876372295276928:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 361us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.359390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:0.0:1789448318.377918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448318.381377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277056 00000100:00100000:1.0:1789448318.381392:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277056 00000100:00100000:1.0:1789448318.381468:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1789448318.381480:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+12:5591:x1876372295277056:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448318.381497:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448318.381517:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec92 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448318.381566:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec92 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448318.381579:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec92 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448318.381589:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58200, rc 0) 00000100:00100000:1.0:1789448318.381661:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295277056:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 184us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.381668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:0.0:1789448318.384816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.384910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277184 00000100:00100000:2.0:1789448318.384919:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277184 00000100:00100000:2.0:1789448318.384999:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:2.0:1789448318.385011:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295277184:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.385327:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295277184:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 318us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.385335:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:3.0:1789448318.390665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.390874:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277312 00000100:00100000:2.0:1789448318.390884:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277312 00000100:00100000:2.0:1789448318.390943:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:2.0:1789448318.390961:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295277312:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.391203:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:5591:x1876372295277312:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 251us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.391212:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:0.0:1789448318.395863:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.397102:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277440 00000100:00100000:2.0:1789448318.397114:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277440 00000100:00100000:2.0:1789448318.397185:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:2.0:1789448318.397195:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:9968:x1876372295277440:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448318.397933:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:9968:x1876372295277440:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 737us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.397942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:0.0:1789448318.413455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.414103:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277568 00000100:00100000:2.0:1789448318.414113:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277568 00000100:00100000:2.0:1789448318.414169:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 262 00000100:00100000:2.0:1789448318.414180:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:9968:x1876372295277568:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448318.414486:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:9968:x1876372295277568:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 307us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.414495:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 262 10000000:01000000:1.0:1789448318.553391:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789448318.553399:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9e7a74000 from 7 10000000:01000000:1.0:1789448318.553404:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789448318.553461:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448318.553486:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448318.553499:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448318.553527:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.553606:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448318.553677:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c845ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.554595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333248 00000100:00100000:2.0:1789448318.554604:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333248 00000100:00100000:2.0:1789448318.554660:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789448318.554671:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:5831:x1876372317333248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448318.554686:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448318.554701:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2000/0xe29566c2465f99c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f99be expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.554727:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2000/0xe29566c2465f99c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f99be expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.554737:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2000/0xe29566c2465f99c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f99be expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.554746:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2000, rc 0) 00000100:00100000:2.0:1789448318.554810:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.554816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789448318.554974:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448318.555003:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448318.555031:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448318.555095:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448318.555127:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448318.555159:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.555398:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333376 00000100:00100000:1.0:1789448318.555403:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333376 00000100:00100000:1.0:1789448318.555443:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789448318.555456:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.555709:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.555717:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789448318.555933:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448318.555984:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448318.556441:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448318.556482:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.557597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333504 00000100:00100000:1.0:1789448318.557608:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333504 00000100:00100000:1.0:1789448318.557665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789448318.557674:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.557891:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.557899:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789448318.559552:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448318.560633:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11669:1876372317333632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448318.560702:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448318.560747:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.560816:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333632 00000100:00100000:2.0:1789448318.560822:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333632 00000100:00100000:2.0:1789448318.560868:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789448318.560877:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:11669:x1876372317333632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448318.561579:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:11669:x1876372317333632:12345-0@lo:502:llog_process_th.0 Request processed in 702us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.561598:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789448318.561754:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11669:1876372317333632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448318.561785:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448318.561794:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448318.561797:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789448318.561804:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97d9e7a74000 00000020:00000080:3.0:1789448318.561806:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789448318.561949:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11669:1876372317333760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448318.562018:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448318.562049:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.571993:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333760 00000100:00100000:2.0:1789448318.572012:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333760 00000100:00100000:2.0:1789448318.572084:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789448318.572096:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:11669:x1876372317333760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448318.572433:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:11669:x1876372317333760:12345-0@lo:502:llog_process_th.0 Request processed in 338us (10414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.572442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789448318.572909:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11669:1876372317333760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448318.572969:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448318.572995:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448318.572999:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789448318.573004:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789448318.573795:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789448318.573821:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448318.573831:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.573844:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448318.573856:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789448318.573859:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c336e800 from 7 10000000:01000000:2.0:1789448318.573862:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448318.573895:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.573903:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.573912:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448318.573936:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.574037:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.574084:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448318.574421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317333888 00000100:00100000:3.0:1789448318.574430:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317333888 00000100:00100000:3.0:1789448318.574484:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789448318.574495:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:5831:x1876372317333888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448318.574508:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448318.574524:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad26c00/0xe29566c2465f99d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f99cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448318.574551:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad26c00/0xe29566c2465f99d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f99cc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448318.574561:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad26c00/0xe29566c2465f99d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f99cc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448318.574569:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26c00, rc 0) 00000100:00100000:3.0:1789448318.574608:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317333888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448318.574614:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789448318.577161:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317333888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448318.577191:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.577206:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448318.577321:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.577372:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.577404:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.577576:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334016 00000100:00100000:1.0:1789448318.577584:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334016 00000100:00100000:1.0:1789448318.577629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789448318.577638:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317334016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.577896:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317334016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.577904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789448318.578008:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.578040:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.578080:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.578110:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.578189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334144 00000100:00100000:1.0:1789448318.578195:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334144 00000100:00100000:1.0:1789448318.578254:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789448318.578262:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317334144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.578397:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317334144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.578404:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789448318.578717:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.579679:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11670:1876372317334272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448318.579738:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.579766:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.579827:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334272 00000100:00100000:1.0:1789448318.579844:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334272 00000100:00100000:1.0:1789448318.579887:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789448318.579896:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:11670:x1876372317334272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448318.583393:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:11670:x1876372317334272:12345-0@lo:502:llog_process_th.0 Request processed in 3489us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.583421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789448318.596096:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11670:1876372317334272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448318.596773:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448318.596786:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448318.596789:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789448318.596797:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97d9c336e800 00000020:00000080:2.0:1789448318.596800:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789448318.596901:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11670:1876372317334400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448318.597007:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.597043:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.597071:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334400 00000100:00100000:2.0:1789448318.597078:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334400 00000100:00100000:2.0:1789448318.597119:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789448318.597128:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:11670:x1876372317334400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448318.597367:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:11670:x1876372317334400:12345-0@lo:502:llog_process_th.0 Request processed in 240us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.597375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789448318.597433:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11670:1876372317334400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448318.597452:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448318.597456:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448318.597458:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789448318.597461:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789448318.597585:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789448318.597603:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448318.597612:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597624:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448318.597634:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789448318.597637:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9c6cee800 from 7 10000000:01000000:2.0:1789448318.597640:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448318.597663:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597671:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597687:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448318.597701:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.597730:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.597746:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.597759:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334528 00000100:00100000:2.0:1789448318.597762:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334528 00000100:00100000:2.0:1789448318.597784:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789448318.597790:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:5831:x1876372317334528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448318.597799:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448318.597811:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f99e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465f99da expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597830:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f99e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465f99da expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597841:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f99e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465f99da expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597850:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2200, rc 0) 00000100:00100000:2.0:1789448318.597873:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317334528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.597878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789448318.597902:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448318.597913:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.597926:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448318.597974:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.597994:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.598005:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.598013:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334656 00000100:00100000:2.0:1789448318.598016:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334656 00000100:00100000:2.0:1789448318.598029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789448318.598034:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317334656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.598201:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317334656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.598207:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789448318.598255:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.598277:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.598304:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448318.598314:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31540 going to sleep for 11 seconds 00000100:00100000:2.0:1789448318.598323:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334784 00000100:00100000:2.0:1789448318.598325:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334784 00000100:00100000:2.0:1789448318.598339:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789448318.598344:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317334784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448318.598439:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:5831:x1876372317334784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.598446:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789448318.598477:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7fbad7-cbfc-4005-a352-7f3edcab574e:5831:1876372317334784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448318.603299:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0100a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11672:1876372317334912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448318.603392:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448318.603457:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317334912 00000100:00100000:1.0:1789448318.603464:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317334912 00000100:00100000:1.0:1789448318.603506:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789448318.603514:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:11672:x1876372317334912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448318.603736:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:11672:x1876372317334912:12345-0@lo:502:llog_process_th.0 Request processed in 222us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.603744:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789448318.603796:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1996480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448318.603820:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0100a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11672:1876372317334912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789448318.603848:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448318.603856:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448318.603859:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789448318.603867:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97d9c6cee800 00000020:00000080:1.0:1789448318.603869:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789448318.605235:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11672:1876372317335040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448318.605303:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448318.605329:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448318.605354:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335040 00000100:00100000:0.0:1789448318.605360:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335040 00000100:00100000:0.0:1789448318.605394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789448318.605402:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:11672:x1876372317335040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448318.605596:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:11672:x1876372317335040:12345-0@lo:502:llog_process_th.0 Request processed in 194us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448318.605604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789448318.605649:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7fbad7-cbfc-4005-a352-7f3edcab574e:11672:1876372317335040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789448318.605671:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448318.605677:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448318.605680:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789448318.605684:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789448318.605946:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789448318.607176:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448318.607190:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448318.607203:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448318.645846:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789448318.919554:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448318.919608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448318.919735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277824 00000100:00100000:0.0:1789448318.919748:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277824 00000100:00100000:0.0:1789448318.919858:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:0.0:1789448318.919872:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295277824:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448318.919999:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295277824:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 130us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448318.920007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00080000:2.0:1789448318.920261:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448318.920467:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277696 00000100:00100000:1.0:1789448318.920473:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277696 00000100:00100000:1.0:1789448318.920518:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:1.0:1789448318.920526:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295277696:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448318.920583:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295277696:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 58us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.920590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:3.0:1789448318.927835:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448318.927903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448318.928203:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295277952 00000100:00100000:2.0:1789448318.928260:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295277952 00000100:00100000:2.0:1789448318.928362:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:2.0:1789448318.928374:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295277952:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448318.928484:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295277952:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 112us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448318.928492:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:1.0:1789448318.929353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278080 00000100:00100000:1.0:1789448318.929362:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278080 00000100:00100000:1.0:1789448318.929425:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:1.0:1789448318.929436:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295278080:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448318.929495:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295278080:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448318.929501:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00080000:3.0:1789448318.929879:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448318.929885:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789448319.129580:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448319.707170:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789448320.153615:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448321.180535:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448321.817550:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317335296:0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.817626:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448321.817685:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317335808:0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.817707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448321.817738:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448321.817744:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317335424:0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.817769:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448321.817797:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335808 00000100:00100000:0.0:1789448321.817804:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335808 00000100:00100000:0.0:1789448321.817851:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448321.817859:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.818037:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317335808:12345-0@lo:400:kworker.0 Request processed in 177us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448321.818044:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448321.818084:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317335808:0@lo:400:kworker.0 00000100:00100000:2.0:1789448321.818153:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335296 00000100:00100000:2.0:1789448321.818158:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335296 00000100:00100000:2.0:1789448321.818191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335424 00000100:00100000:2.0:1789448321.818194:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335424 00000100:00100000:2.0:1789448321.818213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789448321.818238:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317335296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448321.818272:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317335296:12345-0@lo:400:kworker.0 Request processed in 54us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448321.818279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789448321.818291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789448321.818296:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317335424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448321.818333:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317335424:12345-0@lo:400:kworker.0 Request processed in 37us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448321.818339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789448321.818444:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317335168:0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448321.818498:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317335680:0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448321.818531:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448321.818536:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317335552:0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448321.818601:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335552 00000100:00100000:3.0:1789448321.818605:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335552 00000100:00100000:3.0:1789448321.818627:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789448321.818633:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317335552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818665:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317335552:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448321.818671:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789448321.818690:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335680 00000100:00100000:3.0:1789448321.818692:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335680 00000100:00100000:3.0:1789448321.818707:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789448321.818712:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317335680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818739:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317335680:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448321.818744:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1789448321.818759:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789448321.818769:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448321.818771:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789448321.818804:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9ce825180 x1876372317335552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448321.818814:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317335552:0@lo:400:kworker.0 00000100:00100000:3.0:1789448321.818823:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317335680:0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.819064:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335168 00000100:00100000:0.0:1789448321.819068:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335168 00000100:00100000:0.0:1789448321.819099:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789448321.819105:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317335168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.819138:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317335168:12345-0@lo:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448321.819144:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789448321.819206:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317335424:0@lo:400:kworker.0 00000100:00100000:0.0:1789448321.819235:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317335296:0@lo:400:kworker.0 00000100:00100000:2.0:1789448321.820140:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317335168:0@lo:400:kworker.0 00000001:00080000:3.0:1789448321.887615:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789448322.201496:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448322.331251:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317335936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448322.331337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448322.331483:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317335936 00000100:00100000:2.0:1789448322.331491:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317335936 00000100:00100000:2.0:1789448322.331544:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789448322.331553:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317335936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448322.331587:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448322.331656:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317335936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448322.331663:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448322.331914:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789448322.331936:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9f4df0380, transno 4294967300 00000100:00100000:1.0:1789448322.331957:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317335936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448322.841497:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317336064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448322.841560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448322.841957:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336064 00000100:00100000:2.0:1789448322.841965:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336064 00000100:00100000:2.0:1789448322.842011:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789448322.842020:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317336064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448322.842062:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1789448322.842209:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eafd1f80 x1876372317336064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448322.842256:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317336064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448322.842343:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317336064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 323us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448322.842351:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:3.0:1789448323.225768:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448324.034384:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448324.034431:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448324.034467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448324.034511:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448324.034547:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278464 00000100:00100000:3.0:1789448324.034556:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278464 00000100:00100000:3.0:1789448324.034615:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1789448324.034626:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295278464:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448324.034702:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295278464:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448324.034710:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00080000:3.0:1789448324.034825:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448324.034996:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278336 00000100:00100000:0.0:1789448324.035001:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278336 00000100:00100000:0.0:1789448324.035052:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278592 00000100:00100000:0.0:1789448324.035055:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278592 00000100:00100000:0.0:1789448324.035075:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:0.0:1789448324.035083:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295278336:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448324.035125:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295278336:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448324.035132:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:0.0:1789448324.035157:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1789448324.035164:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295278592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448324.035201:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295278592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448324.035207:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:1.0:1789448324.035462:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278208 00000100:00100000:1.0:1789448324.035467:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278208 00000100:00100000:1.0:1789448324.035505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:1.0:1789448324.035513:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295278208:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448324.035543:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295278208:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448324.035570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00080000:3.0:1789448324.036408:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448324.249527:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448325.273614:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448326.307422:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448326.939606:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317336192:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.939735:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317336704:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939762:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.939786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448326.939792:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317336576:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.939841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317336320:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.939895:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317336832:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.939933:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448326.939938:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317336448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.939958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448326.940003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336192 00000100:00100000:1.0:1789448326.940011:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336192 00000100:00100000:1.0:1789448326.940057:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789448326.940065:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317336192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940115:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317336192:12345-0@lo:400:kworker.0 Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940122:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789448326.940156:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336576 00000100:00100000:1.0:1789448326.940160:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336576 00000100:00100000:1.0:1789448326.940209:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336832 00000100:00100000:1.0:1789448326.940214:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336832 00000100:00100000:1.0:1789448326.940277:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448326.940286:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940323:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317336576:12345-0@lo:400:kworker.0 Request processed in 40us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940329:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448326.940345:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789448326.940354:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317336832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940391:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317336832:12345-0@lo:400:kworker.0 Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940396:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789448326.940411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336704 00000100:00100000:1.0:1789448326.940414:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336704 00000100:00100000:1.0:1789448326.940440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336320 00000100:00100000:1.0:1789448326.940444:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336320 00000100:00100000:1.0:1789448326.940458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336448 00000100:00100000:1.0:1789448326.940460:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336448 00000100:00100000:1.0:1789448326.940480:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789448326.940488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317336704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940520:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317336704:12345-0@lo:400:kworker.0 Request processed in 34us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789448326.940540:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789448326.940546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317336320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940574:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317336320:12345-0@lo:400:kworker.0 Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789448326.940605:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789448326.940613:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317336448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940643:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317336448:12345-0@lo:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448326.940648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789448326.940675:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448326.940679:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448326.940681:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448326.940754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317336448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317336320:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940775:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317336832:0@lo:400:kworker.0 00010000:00080000:1.0:1789448326.940818:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fac79180 x1876372317336576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448326.940831:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317336576:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940842:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317336192:0@lo:400:kworker.0 00000100:00100000:1.0:1789448326.940854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317336704:0@lo:400:kworker.0 00010000:00010000:3.0:1789448327.322567:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448327.450620:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448327.456187:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317336960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448327.456282:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448327.456597:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317336960 00000100:00100000:0.0:1789448327.456606:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317336960 00000100:00100000:0.0:1789448327.456961:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448327.456973:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317336960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448327.457012:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448327.457085:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317336960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448327.457092:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789448327.457414:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317336960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448327.965546:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448327.965588:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317337088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448327.965660:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448327.965738:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337088 00000100:00100000:2.0:1789448327.965747:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337088 00000100:00100000:2.0:1789448327.965798:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789448327.965807:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317337088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448327.965842:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448327.965908:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317337088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448327.965915:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789448327.965956:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eafd0700 x1876372317337088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448327.965975:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317337088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448328.348473:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448329.151072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448329.151126:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448329.151180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448329.151275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448329.151330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278848 00000100:00100000:2.0:1789448329.151345:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278848 00000100:00100000:2.0:1789448329.151440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279104 00000100:00100000:2.0:1789448329.151444:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279104 00000100:00100000:2.0:1789448329.151478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:2.0:1789448329.151492:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295278848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448329.151513:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278976 00000100:00100000:1.0:1789448329.151524:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278976 00000100:00100000:1.0:1789448329.151582:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:1.0:1789448329.151591:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295278976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448329.151601:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295278848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448329.151611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:2.0:1789448329.151643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:0.0:1789448329.151646:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295278720 00000100:00100000:0.0:1789448329.151655:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295278720 00000100:00100000:2.0:1789448329.151661:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295279104:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448329.151661:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295278976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 64us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448329.151683:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:2.0:1789448329.151711:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295279104:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448329.151718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:0.0:1789448329.151729:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295278720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448329.151746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:0.0:1789448329.151775:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295278720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 46us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448329.151784:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00080000:3.0:1789448329.152006:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448329.152011:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448329.369498:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448329.945770:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789448330.394476:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448331.420435:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448332.057769:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317337472:0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.057875:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448332.057952:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789448332.057959:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317337344:0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.057983:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448332.058010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317337856:0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.058037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448332.058073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337472 00000100:00100000:2.0:1789448332.058083:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337472 00000100:00100000:2.0:1789448332.058162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337344 00000100:00100000:2.0:1789448332.058166:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337344 00000100:00100000:2.0:1789448332.058191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789448332.058200:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317337472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.058299:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317337472:12345-0@lo:400:kworker.0 Request processed in 100us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448332.058308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789448332.058327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789448332.058333:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.058360:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317337344:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448332.058366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1789448332.058388:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448332.058426:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317337344:0@lo:400:kworker.0 00000100:00100000:2.0:1789448332.058437:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317337472:0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.058878:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337856 00000100:00100000:1.0:1789448332.058885:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337856 00000100:00100000:1.0:1789448332.058937:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448332.058945:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317337856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.058993:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317337856:12345-0@lo:400:kworker.0 Request processed in 48us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448332.058999:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448332.059032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317337856:0@lo:400:kworker.0 00000100:00100000:0.0:1789448332.059369:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317337216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448332.059420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448332.059450:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317337728:0@lo:400:kworker.0 00000100:00100000:0.0:1789448332.059474:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448332.059494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448332.059502:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317337600:0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.059640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337216 00000100:00100000:1.0:1789448332.059645:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337216 00000100:00100000:1.0:1789448332.059676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789448332.059683:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317337216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.059729:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317337216:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448332.059737:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789448332.060139:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337728 00000100:00100000:1.0:1789448332.060144:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337728 00000100:00100000:1.0:1789448332.060190:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789448332.060196:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317337728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.060625:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317337728:12345-0@lo:400:kworker.0 Request processed in 427us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448332.060633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1789448332.060964:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448332.060969:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448332.061468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448332.061663:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317337216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448332.061688:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317337728:0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.064455:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337600 00000100:00100000:1.0:1789448332.064506:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337600 00000100:00100000:1.0:1789448332.064603:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789448332.064615:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317337600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448332.064757:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317337600:12345-0@lo:400:kworker.0 Request processed in 143us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448332.064765:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789448332.066554:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789448332.067412:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9eafd1f80 x1876372317337600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448332.067434:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317337600:0@lo:400:kworker.0 00010000:00010000:3.0:1789448332.446000:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448332.569660:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448332.569684:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317337984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448332.569758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448332.570020:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317337984 00000100:00100000:3.0:1789448332.570030:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317337984 00000100:00100000:3.0:1789448332.570084:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789448332.570095:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317337984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448332.570140:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448332.570201:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317337984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448332.570209:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448332.570406:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317337984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448333.086804:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317338112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448333.086887:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448333.087019:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338112 00000100:00100000:2.0:1789448333.087028:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338112 00000100:00100000:2.0:1789448333.087080:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789448333.087089:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317338112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448333.087122:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448333.092361:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317338112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5263us (5463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448333.092378:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789448333.097010:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01eb5880 x1876372317338112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448333.097039:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317338112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448333.465418:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448334.272713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448334.272863:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279232 00000100:00100000:0.0:1789448334.272897:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279232 00000100:00100000:0.0:1789448334.273190:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:0.0:1789448334.273202:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295279232:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448334.273348:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2351:x1876372295279232:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 148us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448334.273355:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:2.0:1789448334.280872:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448334.280908:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448334.280977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448334.281008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279360 00000100:00100000:2.0:1789448334.281019:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279360 00000100:00100000:2.0:1789448334.281081:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279616 00000100:00100000:2.0:1789448334.281084:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279616 00000100:00100000:2.0:1789448334.281107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1789448334.281116:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295279360:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448334.281209:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295279360:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448334.281245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1789448334.281264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:2.0:1789448334.281289:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295279616:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448334.281316:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2351:x1876372295279616:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448334.281322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:2.0:1789448334.281343:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279488 00000100:00100000:2.0:1789448334.281347:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279488 00000100:00100000:2.0:1789448334.281378:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789448334.281385:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2347:x1876372295279488:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:2.0:1789448334.281407:0:6671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f991d 00000100:00080000:2.0:1789448334.281417:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97d8c2305800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448334.281458:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789448334.281713:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+2:2347:x1876372295279488:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 327us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448334.281720:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00080000:2.0:1789448334.281737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448334.281742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789448334.281759:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448334.489927:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448335.513601:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448336.537660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448337.181475:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317338240:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181581:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317338752:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181622:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448337.181628:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317338624:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181675:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317338368:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181718:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317338880:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181733:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181746:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448337.181751:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317338496:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448337.181805:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338240 00000100:00100000:2.0:1789448337.181813:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338240 00000100:00100000:2.0:1789448337.181853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789448337.181861:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317338240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.181922:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317338240:12345-0@lo:400:kworker.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.181929:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789448337.181960:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338752 00000100:00100000:2.0:1789448337.181964:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338752 00000100:00100000:2.0:1789448337.181996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338368 00000100:00100000:2.0:1789448337.181999:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338368 00000100:00100000:2.0:1789448337.182009:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338496 00000100:00100000:2.0:1789448337.182011:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338496 00000100:00100000:2.0:1789448337.182022:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789448337.182027:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317338752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182057:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317338752:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.182063:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789448337.182074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789448337.182080:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317338368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182123:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317338368:12345-0@lo:400:kworker.0 Request processed in 42us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.182135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789448337.182151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789448337.182157:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182185:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317338496:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.182190:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789448337.182207:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338624 00000100:00100000:2.0:1789448337.182211:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338624 00000100:00100000:2.0:1789448337.182251:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317338880 00000100:00100000:2.0:1789448337.182254:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317338880 00000100:00100000:2.0:1789448337.182272:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789448337.182277:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182307:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317338624:12345-0@lo:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.182313:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789448337.182324:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789448337.182330:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182359:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317338880:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448337.182365:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789448337.182392:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448337.182396:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448337.182399:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448337.182661:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317338496:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182672:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317338368:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182680:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317338880:0@lo:400:kworker.0 00010000:00080000:2.0:1789448337.182732:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9d1016d80 x1876372317338624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448337.182744:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317338624:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.182753:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317338240:0@lo:400:kworker.0 00000100:00100000:2.0:1789448337.183044:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317338752:0@lo:400:kworker.0 00000001:00100000:3.0:1789448337.281147:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:3.0:1789448337.281158:0:7625:0:(genops.c:885:class_export_put()) final put ffff97d8c2303800/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:2.0:1789448337.281370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c2303800/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-OST0001 00000020:00000080:2.0:1789448337.281433:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d8c2305800 for lustre-OST0001 00010000:00010000:3.0:1789448337.562690:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448337.693750:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448337.693795:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448337.693877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448337.693965:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339008 00000100:00100000:0.0:1789448337.693973:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339008 00000100:00100000:0.0:1789448337.694025:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789448337.694034:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317339008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448337.694072:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448337.694130:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317339008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448337.694137:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789448337.694189:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448338.207909:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448338.207946:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317339136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448338.208020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448338.208253:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339136 00000100:00100000:0.0:1789448338.208261:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339136 00000100:00100000:0.0:1789448338.208311:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789448338.208320:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317339136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448338.208367:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448338.208420:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317339136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448338.208428:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789448338.208730:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97da01eb5880 x1876372317339136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448338.208751:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317339136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789448338.592981:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448339.161785:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789448339.391300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448339.391353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448339.391382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448339.391412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279872 00000100:00100000:3.0:1789448339.391421:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279872 00000100:00100000:3.0:1789448339.391478:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280000 00000100:00100000:3.0:1789448339.391482:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280000 00000100:00100000:3.0:1789448339.391507:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:3.0:1789448339.391516:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295279872:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448339.391588:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2351:x1876372295279872:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448339.391595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:3.0:1789448339.391615:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:3.0:1789448339.391622:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295280000:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448339.391649:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295280000:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448339.391655:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00080000:3.0:1789448339.391672:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448339.391842:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295279744 00000100:00100000:0.0:1789448339.391847:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295279744 00000100:00100000:0.0:1789448339.391886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:0.0:1789448339.391893:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295279744:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448339.391928:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295279744:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448339.391935:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 286 00010000:00010000:2.0:1789448339.609879:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448340.638113:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448341.352001:0:11837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:59:00 (1789448340) 00010000:00010000:1.0:1789448341.657638:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448342.298433:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317339264:0@lo:400:kworker.0 00000100:00100000:1.0:1789448342.298501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448342.298590:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339264 00000100:00100000:1.0:1789448342.298598:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339264 00000100:00100000:1.0:1789448342.298639:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789448342.298648:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317339264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448342.298695:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3305:x1876372317339264:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448342.298701:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789448342.298756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3305:1876372317339264:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302137:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317339392:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.302255:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317339904:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302280:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.302302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448342.302308:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317339520:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.302358:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317339776:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.302398:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448342.302404:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317339648:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302424:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.302466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339392 00000100:00100000:0.0:1789448342.302472:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339392 00000100:00100000:0.0:1789448342.302526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339520 00000100:00100000:0.0:1789448342.302529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339520 00000100:00100000:0.0:1789448342.302550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339776 00000100:00100000:0.0:1789448342.302552:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339776 00000100:00100000:0.0:1789448342.302568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789448342.302575:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317339392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302632:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317339392:12345-0@lo:400:kworker.0 Request processed in 56us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448342.302639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789448342.302654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789448342.302660:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302685:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317339520:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448342.302690:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789448342.302700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789448342.302705:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317339776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302744:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317339776:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448342.302750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789448342.302797:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317339520:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302805:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317339392:0@lo:400:kworker.0 00000100:00100000:0.0:1789448342.302840:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317339776:0@lo:400:kworker.0 00000100:00100000:2.0:1789448342.303195:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339904 00000100:00100000:2.0:1789448342.303200:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339904 00000100:00100000:2.0:1789448342.303248:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317339648 00000100:00100000:2.0:1789448342.303251:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317339648 00000100:00100000:2.0:1789448342.303270:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789448342.303277:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317339904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448342.303320:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317339904:12345-0@lo:400:kworker.0 Request processed in 43us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448342.303326:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789448342.303342:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448342.303348:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317339648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448342.303379:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317339648:12345-0@lo:400:kworker.0 Request processed in 32us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448342.303384:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448342.303421:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317339904:0@lo:400:kworker.0 00010000:00080000:2.0:1789448342.303442:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fffaea00 x1876372317339648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448342.303460:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317339648:0@lo:400:kworker.0 00000100:00080000:3.0:1789448342.307603:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789448342.307612:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448342.307615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448342.399463:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448342.399803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280128 00000100:00100000:0.0:1789448342.399824:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280128 00000100:00100000:0.0:1789448342.399906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789448342.399917:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:10238:x1876372295280128:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448342.399939:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448342.399962:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f99e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ec99 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400057:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400071:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400085:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448342.400117:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448342.400120:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448342.400155:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400190:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465f99e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec99 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400208:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec99 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448342.400260:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030e00) 00010000:00010000:0.0:1789448342.400263:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448342.400266:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448342.400320:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:10238:x1876372295280128:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 404us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448342.400326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00080000:3.0:1789448342.401204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448342.405287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448342.405399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280256 00000100:00100000:2.0:1789448342.405409:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280256 00000100:00100000:2.0:1789448342.405468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1789448342.405478:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:10239:x1876372295280256:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448342.405501:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448342.405531:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f99f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eca0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405590:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405605:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405616:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405630:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405636:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405643:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405877:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405896:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405904:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448342.405933:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789448342.405936:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448342.405956:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405967:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405974:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405981:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.405987:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448342.405992:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406000:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406011:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030e00) 00010000:00010000:2.0:1789448342.406014:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448342.406019:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406244:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f99fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406262:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406268:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406274:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406280:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448342.406283:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406290:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406298:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97d9d6311b00) 00010000:00010000:2.0:1789448342.406301:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448342.406304:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9a04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406343:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f99f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406357:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca0 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448342.406371:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:2.0:1789448342.406374:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448342.406377:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3800, rc 0) 00000100:00100000:2.0:1789448342.406446:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:10239:x1876372295280256:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 968us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448342.406454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789448342.412976:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448342.413295:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280512 00000100:00100000:1.0:1789448342.413305:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280512 00000100:00100000:1.0:1789448342.413360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:1.0:1789448342.413370:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:10239:x1876372295280512:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448342.413390:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448342.413413:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9a12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eca7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413481:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413495:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413520:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413570:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413579:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413586:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413938:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f9a27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f9a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.413967:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f9a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448342.413977:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789448342.414466:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414475:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414482:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414488:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448342.414492:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414500:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414559:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:1.0:1789448342.414562:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448342.414568:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414574:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9a19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414588:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414594:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414607:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414613:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448342.414617:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414623:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448342.414633:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448342.414637:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.414642:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9a20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.418618:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9a12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca7 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.418649:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f9a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca7 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448342.418659:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:1.0:1789448342.418662:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448342.418666:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59800, rc 0) 00000100:00100000:1.0:1789448342.418755:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10239:x1876372295280512:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 5384us (5788us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789448342.418787:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1789448342.423476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448342.423580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280640 00000100:00100000:2.0:1789448342.423591:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280640 00000100:00100000:2.0:1789448342.423648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1789448342.423658:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10239:x1876372295280640:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789448342.423779:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10239:x1876372295280640:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448342.423786:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00010000:00010000:2.0:1789448342.686417:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448342.809683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448342.811975:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317340032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448342.812064:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448342.812404:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317340032 00000100:00100000:0.0:1789448342.812413:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317340032 00000100:00100000:0.0:1789448342.812469:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789448342.812478:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317340032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448342.812535:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448342.812582:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317340032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448342.812589:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789448342.814105:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317340032:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789448343.258081:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789448343.321419:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448343.321443:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317340160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448343.321515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448343.321595:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317340160 00000100:00100000:0.0:1789448343.321603:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317340160 00000100:00100000:0.0:1789448343.321655:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789448343.321667:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317340160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448343.321701:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448343.321841:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317340160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448343.321851:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789448343.321905:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9fffad880 x1876372317340160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448343.321927:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317340160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448343.713385:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448344.453119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448344.453159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295280768 00000100:00100000:3.0:1789448344.453176:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295280768 00000100:00100000:3.0:1789448344.453256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1789448344.453269:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10281:x1876372295280768:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448344.453292:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448344.453313:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453380:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453396:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453410:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453425:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453433:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453439:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453627:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453636:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453643:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453654:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448344.453659:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453667:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453680:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030e00) 00010000:00010000:3.0:1789448344.453683:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448344.453689:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453694:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453706:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453725:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453732:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453737:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448344.453749:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453756:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453774:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97d9d0a5ca00) 00010000:00010000:3.0:1789448344.453776:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448344.453780:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453819:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecae expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453829:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030e00) 00010000:00010000:3.0:1789448344.453831:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448344.453834:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecae expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.453843:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27c00, rc 0) 00000100:00100000:3.0:1789448344.453907:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10281:x1876372295280768:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 641us (797us total) trans 0 rc 301/301 00000100:00100000:3.0:1789448344.453915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00080000:3.0:1789448344.453938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448344.479698:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448344.479853:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281024 00000100:00100000:0.0:1789448344.479864:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281024 00000100:00100000:0.0:1789448344.479952:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789448344.479963:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10281:x1876372295281024:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:0.0:1789448344.480030:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448344.480057:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f99ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec99 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480076:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030e00) 00010000:00010000:0.0:1789448344.480086:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448344.480291:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480302:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480310:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480317:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480322:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.480325:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448344.483460:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789448344.484849:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484865:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484873:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484879:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448344.484884:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484891:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484908:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0030000) 00010000:00010000:1.0:1789448344.484977:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448344.484984:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.484991:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9a4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448344.485015:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003623ed5 reply state 000000007012e790 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448344.485042:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448344.485201:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+10:10281:x1876372295281024:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 5235us (5508us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789448344.485210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:1.0:1789448344.495308:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495326:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495333:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495339:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448344.495344:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495351:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495367:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97d9d0030300) 00010000:00010000:1.0:1789448344.495370:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448344.495375:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.495381:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9a51 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448344.518962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.519054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448344.519156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281152 00000100:00100000:0.0:1789448344.519167:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281152 00000100:00100000:3.0:1789448344.519194:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281280 00000100:00100000:3.0:1789448344.519199:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281280 00000100:00100000:0.0:1789448344.519253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:0.0:1789448344.519264:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295281152:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448344.519266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:3.0:1789448344.519272:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295281280:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:1.0:1789448344.519353:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448344.519419:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295281152:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448344.519443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:3.0:1789448344.519754:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295281280:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 480us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448344.519771:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:0.0:1789448344.617696:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448344.619727:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281408 00000100:00100000:3.0:1789448344.619749:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281408 00000100:00100000:3.0:1789448344.619818:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789448344.619828:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+9:10289:x1876372295281408:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:3.0:1789448344.619854:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448344.619878:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecb5 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.619958:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.619972:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.619984:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448344.620021:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789448344.620025:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448344.620061:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.620086:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecb5 expref: 11 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.620104:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecb5 expref: 10 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.620130:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:3.0:1789448344.620134:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448344.620137:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26000, rc 0) 00000100:00100000:3.0:1789448344.620205:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:10289:x1876372295281408:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 379us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448344.620212:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1789448344.705407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.705578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281536 00000100:00100000:2.0:1789448344.705590:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281536 00000100:00100000:2.0:1789448344.705656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789448344.705667:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+10:10295:x1876372295281536:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448344.705687:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448344.705731:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecbc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705803:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705816:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705828:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705842:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705849:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.705856:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706073:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706082:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706089:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448344.706118:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789448344.706122:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448344.706160:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706182:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706189:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706196:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706202:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448344.706206:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706213:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706281:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:2.0:1789448344.706284:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448344.706289:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706295:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706310:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706317:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706323:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706446:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448344.706449:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706456:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706465:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97d9d6311b00) 00010000:00010000:2.0:1789448344.706467:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448344.706470:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706476:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9a74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706685:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecbc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706700:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecbc expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.706707:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:2.0:1789448344.706710:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789448344.706724:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3e00, rc 0) 00000100:00100000:2.0:1789448344.706843:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+11:10295:x1876372295281536:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1178us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448344.706851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789448344.717736:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448344.717879:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281792 00000100:00100000:3.0:1789448344.717888:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281792 00000100:00100000:3.0:1789448344.718011:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:3.0:1789448344.718023:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+11:10295:x1876372295281792:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789448344.718043:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448344.718065:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecc3 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718189:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718204:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718248:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718305:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718313:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.718332:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789448344.720402:0:7825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789448344.722231:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722252:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722265:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722303:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722310:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722317:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722322:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448344.722334:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722342:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722353:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448344.722356:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448344.722376:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.722383:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9a89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789448344.722397:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b531ea5 reply state 00000000b057d249 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448344.722406:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789448344.724672:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9a82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 14 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.724705:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 13 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.724750:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:3.0:1789448344.724753:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448344.724757:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448344.724843:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10295:x1876372295281792:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6822us (7117us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789448344.724853:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:3.0:1789448344.732616:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448344.733762:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733778:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733786:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733812:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448344.733817:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733825:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733842:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448344.733845:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448344.733851:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.733858:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9a90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448344.743818:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448344.744160:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295281920 00000100:00100000:0.0:1789448344.744171:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295281920 00000100:00100000:0.0:1789448344.744256:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789448344.744265:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876372295281920:12345-192.168.202.54@tcp:8:bash.0 00010000:00080000:0.0:1789448344.744295:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 366 last 0 00000020:00000080:0.0:1789448344.744335:0:6672:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f9aa5 00002000:00100000:0.0:1789448344.744346:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7263448-abed-44d6-a5e0-4aa81ee22270/ffff97d9d1fc0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448344.744358:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1789448344.744589:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789448344.744619:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d9d1fc2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448344.744682:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295281920:12345-192.168.202.54@tcp:8:bash.0 Request processed in 416us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448344.744690:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789448344.759183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.759374:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295282048 00000100:00100000:2.0:1789448344.759385:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295282048 00000100:00100000:2.0:1789448344.759503:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1789448344.759514:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:0:x1876372295282048:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448344.759533:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448344.759557:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecca expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448344.759586:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448344.759607:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1789448344.759611:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448344.759619:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.759644:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.759657:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2600, rc 0) 00000100:00100000:2.0:1789448344.759730:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:0:x1876372295282048:12345-192.168.202.54@tcp:101:bash.0 Request processed in 218us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448344.759848:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1789448344.769359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00080000:1.0:1789448344.769860:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448344.770797:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295282176 00000100:00100000:0.0:1789448344.770811:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295282176 00000100:00100000:0.0:1789448344.770871:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1789448344.770883:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:10295:x1876372295282176:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448344.770902:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448344.770936:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecd1 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.770968:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.770989:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448344.770994:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448344.771000:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.771038:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448344.771054:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448344.771069:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317340288:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448344.771256:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448344.777280:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317340288:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448344.777320:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.777363:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32800, rc 0) 00000100:00100000:2.0:1789448344.777431:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+8:10295:x1876372295282176:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6550us (8081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448344.777441:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1789448344.777749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448344.783205:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295282304 00000100:00100000:1.0:1789448344.783240:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295282304 00010000:00010000:2.0:1789448344.783377:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448344.783431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1789448344.783441:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295282304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448344.783457:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448344.783479:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.783494:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.783519:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9aac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecca expref: 8 pid: 6671 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.783536:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448344.783540:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448344.783548:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.783577:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.783617:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448344.783632:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876372317340416:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789448344.783824:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448344.788123:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876372317340416:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789448344.788147:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448344.788205:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295282304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4765us (10456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448344.788257:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789448344.788568:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.788636:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295282560 00000100:00100000:2.0:1789448344.788643:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295282560 00000100:00100000:2.0:1789448344.788678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448344.788685:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10295:x1876372295282560:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789448344.788988:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10295:x1876372295282560:12345-192.168.202.54@tcp:35:bash.0 Request processed in 303us (422us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789448344.788994:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:0.0:1789448344.924322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448344.924510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295282816 00000100:00100000:3.0:1789448344.924521:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295282816 00000100:00100000:3.0:1789448344.924590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1789448344.924600:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10305:x1876372295282816:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448344.924633:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448344.924656:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecd8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448344.924760:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789448344.924871:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9aba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd8 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.924901:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:3.0:1789448344.924904:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448344.924909:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd8 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448344.924923:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27000, rc 0) 00000100:00100000:3.0:1789448344.924988:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10305:x1876372295282816:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 387us (671us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789448344.924996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1789448344.928570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.928733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283072 00000100:00100000:2.0:1789448344.928744:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283072 00000100:00100000:2.0:1789448344.928810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789448344.928821:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10305:x1876372295283072:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448344.929089:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10305:x1876372295283072:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 269us (530us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789448344.929096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789448344.986086:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448344.986421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283200 00000100:00100000:1.0:1789448344.986433:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283200 00000100:00100000:1.0:1789448344.986498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1789448344.986508:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10311:x1876372295283200:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448344.986660:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448344.986682:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecdf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986774:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986788:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986800:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448344.986835:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789448344.986839:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448344.986856:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986883:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecdf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986903:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecdf expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448344.986932:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448344.986935:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448344.986939:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59e00, rc 0) 00000100:00100000:1.0:1789448344.987004:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10311:x1876372295283200:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 497us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448344.987011:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789448344.993549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448344.993922:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283456 00000100:00100000:2.0:1789448344.993934:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283456 00000100:00100000:2.0:1789448344.994006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:2.0:1789448344.994017:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10311:x1876372295283456:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448344.994036:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448344.994056:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ece6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.994157:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9add lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.994171:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.994182:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448344.994505:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789448344.994722:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ece6 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.994802:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ece6 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448344.994811:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:2.0:1789448344.994827:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448344.994831:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3400, rc 0) 00000100:00100000:2.0:1789448344.994938:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10311:x1876372295283456:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 922us (1400us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789448344.994945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1789448345.014463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448345.014515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.015902:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283840 00000100:00100000:3.0:1789448345.015918:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283840 00000100:00100000:3.0:1789448345.015993:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1789448345.016004:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10311:x1876372295283840:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448345.016030:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448345.016053:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eced expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.016155:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.016170:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.016181:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448345.016242:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789448345.016371:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eced expref: 22 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.016391:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eced expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.016399:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:3.0:1789448345.016402:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789448345.016406:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27000, rc 0) 00000100:00100000:3.0:1789448345.016472:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10311:x1876372295283840:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 469us (1955us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789448345.016490:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789448345.019026:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283584 00000100:00100000:0.0:1789448345.019045:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283584 00000100:00100000:0.0:1789448345.019140:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789448345.019152:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+21:2350:x1876372295283584:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448345.019176:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448345.019211:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9add lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ece6 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.019291:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:0.0:1789448345.019296:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448345.019358:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+20:2350:x1876372295283584:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 208us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448345.019365:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789448345.027874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.028151:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295283968 00000100:00100000:3.0:1789448345.028160:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295283968 00000100:00100000:3.0:1789448345.028263:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1789448345.028274:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2349:x1876372295283968:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:3.0:1789448345.028321:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.028341:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.028350:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448345.028355:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448345.028360:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.028411:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.028426:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448345.028440:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eacc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876372317340544:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448345.028519:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d11f1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448345.035538:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.035697:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284096 00000100:00100000:2.0:1789448345.035721:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284096 00002000:00100000:2.0:1789448345.035781:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97d9fac7a300 x1876372295284096/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:206/0 lens 504/0 e 0 to 0 dl 1789448356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448345.035793:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fac7a300 with x1876372295284096 ext(0->12) 00010000:00010000:2.0:1789448345.035802:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 8 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.035820:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 8 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448345.035829:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9fac7a300 00000100:00100000:2.0:1789448345.035862:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789448345.035873:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295284096:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:3.0:1789448345.042214:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eacc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876372317340544:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448345.042289:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789448345.116061:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000100:00100000:2.0:1789448345.142297:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295284096:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 106415us (106765us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789448345.142313:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:2.0:1789448345.142326:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97d9fac7a300 x1876372295284096/t4294967299(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:206/0 lens 504/448 e 0 to 0 dl 1789448356 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448345.142337:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fac7a300 with x1876372295284096 ext(0->12) 00010000:00010000:2.0:1789448345.142359:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 9 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.142378:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 9 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448345.142386:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9fac7a300 00000001:00080000:1.0:1789448345.143034:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789448345.147787:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.152098:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284224 00000100:00100000:3.0:1789448345.152115:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284224 00010000:00010000:2.0:1789448345.155375:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448345.155619:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1789448345.155628:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295284224:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448345.155642:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789448345.155660:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789448345.155662:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789448344 00002000:00010000:2.0:1789448345.155664:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789448345 00002000:00010000:2.0:1789448345.155665:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789448344 00002000:00010000:2.0:1789448345.155667:0:5820:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789448345.155672:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.155681:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.155701:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a3b2ac/0xe29566c2465f9ab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecd1 expref: 7 pid: 6672 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.155760:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448345.155764:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448345.155770:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.155777:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.155807:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448345.155859:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295284224:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 233us (8084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448345.155864:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00010000:00010000:0.0:1789448345.155913:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155920:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155939:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155944:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155949:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155953:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448345.155957:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155962:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155978:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.155983:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f4da98/0xe29566c2465f9b00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448345.156023:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295283968:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 127752us (128159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448345.156031:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789448345.159180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.159351:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284480 00000100:00100000:2.0:1789448345.159363:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284480 00000100:00100000:2.0:1789448345.159486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448345.159495:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ffface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:10311:x1876372295284480:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:2.0:1789448345.159549:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eced expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448345.159837:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789448345.159873:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789448345.160555:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789448345.160598:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.160609:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 24 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.160622:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.160648:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 24 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.160660:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 24 pid: 7825 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448345.160671:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317340672:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448345.160834:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f53683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448345.172110:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448345.172398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284608 00000100:00100000:0.0:1789448345.172410:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284608 00010000:00010000:0.0:1789448345.172447:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 25 pid: 7825 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448345.172576:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789448345.172585:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+25:2351:x1876372295284608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448345.172599:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448345.172605:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 25 pid: 7825 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.172616:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 25 pid: 7825 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.172637:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:0.0:1789448345.172655:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.172663:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.172668:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.172685:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448345.172762:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+25:2351:x1876372295284608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 176us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448345.172770:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:2.0:1789448345.173003:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecc3 expref: 24 pid: 7825 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448345.173018:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317340672:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448345.173035:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.173041:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.173045:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448345.173156:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789448345.173340:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789448345.173452:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317340800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789448345.173506:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448345.173524:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448345.173625:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317340800 00000100:00100000:1.0:1789448345.173629:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317340800 00000100:00100000:1.0:1789448345.173667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448345.173673:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317340800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789448345.173762:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317340800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448345.173768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448345.173801:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317340800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789448345.174339:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789448345.174382:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317340928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789448345.174412:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448345.174428:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448345.174437:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317340928 00000100:00100000:1.0:1789448345.174441:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317340928 00000100:00100000:1.0:1789448345.174457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448345.174461:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317340928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789448345.174606:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1876372317340928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (192us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789448345.174611:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448345.174644:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317340928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789448345.174674:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789448345.174697:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174704:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174724:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174730:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448345.174734:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174742:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174758:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:1.0:1789448345.174762:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789448345.174772:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.174777:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448345.174889:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789448345.175034:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789448345.175043:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366877824585ns, next at 367877823263ns, rc = 0 00000001:00080000:1.0:1789448345.175047:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789448345.175067:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c300) 00010000:00010000:1.0:1789448345.175069:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789448345.175073:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9af2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eced expref: 28 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448345.175151:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ffface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:10311:x1876372295284480:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 15657us (15978us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789448345.175172:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000020:00080000:1.0:1789448345.175177:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1789448345.175673:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448345.178361:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.178553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284736 00000100:00100000:3.0:1789448345.178562:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284736 00000100:00100000:3.0:1789448345.178627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1789448345.178635:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:10311:x1876372295284736:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448345.178654:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448345.178671:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecf4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.178729:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9b0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecf4 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.178766:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9b0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecf4 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.178782:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448345.178784:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448345.178787:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27c00, rc 0) 00000100:00100000:3.0:1789448345.178832:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:10311:x1876372295284736:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 198us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448345.178837:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789448345.187109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448345.187207:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295284992 00000100:00100000:0.0:1789448345.187285:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295284992 00000100:00100000:1.0:1789448345.187396:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448345.187403:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+28:10311:x1876372295284992:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448345.187630:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10311:x1876372295284992:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 227us (531us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789448345.187637:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448345.288002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.288490:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295285248 00000100:00100000:3.0:1789448345.288504:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295285248 00000100:00100000:2.0:1789448345.288820:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1789448345.288836:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10321:x1876372295285248:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448345.288871:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448345.288900:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ecfb expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448345.289024:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789448345.289591:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9b15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecfb expref: 31 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.289609:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:2.0:1789448345.289613:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448345.289620:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecfb expref: 31 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.289640:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3a00, rc 0) 00000100:00100000:2.0:1789448345.289830:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10321:x1876372295285248:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 997us (1844us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789448345.289838:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:3.0:1789448345.292091:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.292135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295285376 00000100:00100000:2.0:1789448345.292148:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295285376 00000100:00100000:2.0:1789448345.292412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1789448345.292424:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10321:x1876372295285376:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789448345.292521:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292557:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292572:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292591:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292599:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292606:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292880:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292887:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292892:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448345.292939:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292952:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292957:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292971:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292976:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448345.292980:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292985:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.292996:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:2.0:1789448345.292998:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448345.293003:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293008:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293018:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293021:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293025:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293029:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448345.293031:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293040:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293045:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d6311a00) 00010000:00010000:2.0:1789448345.293047:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448345.293048:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293051:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293065:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293068:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293071:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293074:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448345.293075:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293079:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293083:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448345.293085:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448345.293086:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.293095:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448345.293428:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10321:x1876372295285376:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1004us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448345.293437:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789448345.295745:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448345.295877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295285632 00000100:00100000:1.0:1789448345.295948:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295285632 00000100:00100000:1.0:1789448345.296028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448345.296037:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10321:x1876372295285632:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448345.296454:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+31:10321:x1876372295285632:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 415us (722us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789448345.296463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448345.331906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.332887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295285888 00000100:00100000:2.0:1789448345.332905:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295285888 00000100:00100000:3.0:1789448345.333079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789448345.333093:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+31:10324:x1876372295285888:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448345.333124:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448345.333148:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9b38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333418:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333436:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333452:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333490:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333496:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333501:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333917:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333925:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.333931:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448345.333940:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789448345.334049:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334055:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334060:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334064:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448345.334068:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334085:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334097:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448345.334099:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448345.334103:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334108:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9b3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334122:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334126:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334130:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334132:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448345.334134:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334137:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334141:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448345.334142:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448345.334144:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334154:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9b38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334541:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.334549:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448345.334552:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448345.334555:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448345.334658:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10324:x1876372295285888:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1568us (2768us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789448345.334665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1789448345.338062:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448345.338158:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295286016 00000100:00100000:3.0:1789448345.338360:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295286016 00000100:00100000:3.0:1789448345.338474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:3.0:1789448345.338487:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10324:x1876372295286016:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789448345.338578:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338601:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338797:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338850:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338855:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338860:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338864:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448345.338868:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338873:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338884:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448345.338887:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448345.338892:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.338896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448345.339018:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10324:x1876372295286016:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 535us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448345.339023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789448345.341896:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.342010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295286272 00000100:00100000:2.0:1789448345.342023:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295286272 00000100:00100000:2.0:1789448345.342082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789448345.342093:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10324:x1876372295286272:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448345.342599:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+34:10324:x1876372295286272:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 506us (989us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789448345.342606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789448345.565478:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.575758:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295286528 00000100:00100000:2.0:1789448345.575784:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295286528 00000100:00100000:2.0:1789448345.575890:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1789448345.575905:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ffface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+34:10356:x1876372295286528:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789448345.575947:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448345.575975:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed09 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.576116:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.576133:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.576168:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448345.576182:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789448345.576402:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed09 expref: 37 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.576426:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed09 expref: 36 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.576435:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448345.576439:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448345.576444:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448345.577133:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ffface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+36:10356:x1876372295286528:12345-192.168.202.54@tcp:101:cat.0 Request processed in 1226us (11667us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789448345.577143:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1789448345.595447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448345.595584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.595920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295286784 00000100:00100000:2.0:1789448345.595934:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295286784 00000100:00100000:2.0:1789448345.596013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1789448345.596026:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+36:10356:x1876372295286784:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1789448345.596328:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295286912 00000100:00100000:3.0:1789448345.596334:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295286912 00000100:00100000:2.0:1789448345.596477:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+38:10356:x1876372295286784:12345-192.168.202.54@tcp:35:cat.0 Request processed in 453us (1046us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789448345.596491:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789448345.596491:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789448345.596521:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+37:2350:x1876372295286912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448345.596535:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448345.596566:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed09 expref: 37 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.596589:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448345.596595:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448345.596628:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+36:2350:x1876372295286912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 112us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448345.596635:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789448345.711645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.711871:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295287168 00000100:00100000:2.0:1789448345.711888:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295287168 00000100:00100000:2.0:1789448345.711982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1789448345.711996:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+36:10362:x1876372295287168:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:2.0:1789448345.712053:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448345.712057:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789448345.712098:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecdf expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712128:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:2.0:1789448345.712135:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448345.712154:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed10 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712385:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712403:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712414:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712462:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.712479:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 36 pid: 5834 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448345.712497:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317341056:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448345.712649:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448345.721131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448345.721403:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317341056:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448345.721461:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448345.721609:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295287296 00000100:00100000:3.0:1789448345.721621:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295287296 00010000:00010000:3.0:1789448345.721676:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 37 pid: 5834 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448345.721740:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789448345.721753:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+37:2350:x1876372295287296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448345.721775:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448345.721784:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 37 pid: 5834 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721800:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 37 pid: 5834 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721828:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed02 expref: 37 pid: 5834 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721862:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448345.721869:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721883:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721893:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448345.721929:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448345.722011:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+36:2350:x1876372295287296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 260us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448345.722020:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00010000:00010000:2.0:1789448345.722190:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.722199:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448345.722275:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789448345.722553:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9b77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.722575:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.722584:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448345.722587:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789448345.722590:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2a00, rc 0) 00000100:00100000:2.0:1789448345.722624:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+36:10362:x1876372295287168:12345-192.168.202.54@tcp:101:dd.0 Request processed in 10633us (11006us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789448345.722633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1789448345.728097:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448345.730026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295287552 00000100:00100000:1.0:1789448345.730048:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295287552 00000100:00100000:1.0:1789448345.730141:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1789448345.730156:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+36:10362:x1876372295287552:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:1.0:1789448345.731864:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.731896:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448345.731912:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448345.732023:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789448345.732070:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000067e423b reply state 00000000590800ae transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448345.732103:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448345.732517:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+39:10362:x1876372295287552:12345-192.168.202.54@tcp:36:dd.0 Request processed in 2359us (4430us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789448345.732528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000020:00080000:1.0:1789448345.732544:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448345.734759:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734783:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734793:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734800:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448345.734805:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734814:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734856:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448345.734860:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448345.734868:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448345.734876:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9b8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448345.753508:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448346.074470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448346.074909:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295287680 00000100:00100000:1.0:1789448346.074921:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295287680 00000100:00100000:1.0:1789448346.075017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1789448346.075029:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:10376:x1876372295287680:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:1.0:1789448346.075054:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448346.075076:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9b93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed17 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075161:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075174:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075189:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075196:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075202:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075344:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075355:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075365:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075400:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.075415:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 39 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448346.075429:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317341184:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448346.075529:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7300 going to sleep for 11 seconds 00000100:00080000:2.0:1789448346.075645:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448346.083355:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317341184:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448346.083393:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448346.085889:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.086198:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295287936 00000100:00100000:2.0:1789448346.086210:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295287936 00000100:00100000:2.0:1789448346.086295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1789448346.086306:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+40:5589:x1876372295287936:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789448346.087957:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+41:5589:x1876372295287936:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 1642us (2064us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789448346.087995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448346.092347:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448346.092655:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295288064 00000100:00100000:0.0:1789448346.092667:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295288064 00010000:00010000:0.0:1789448346.092725:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 41 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448346.092769:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1789448346.092780:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+41:2351:x1876372295288064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448346.092807:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448346.092815:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 41 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092832:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 41 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092856:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9b7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed10 expref: 41 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092876:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448346.092882:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092910:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092918:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.092952:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448346.093010:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+40:2351:x1876372295288064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 231us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448346.093017:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00010000:00010000:1.0:1789448346.098146:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098168:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448346.098247:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789448346.098253:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448346.098313:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098347:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098359:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098366:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098374:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098400:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448346.098405:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098413:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098430:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448346.098434:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448346.098439:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098446:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098462:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098468:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098481:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098486:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448346.098489:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098495:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9e0bd6500) 00010000:00010000:1.0:1789448346.098507:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448346.098510:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098516:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098566:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9b93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed17 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098581:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed17 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.098588:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:1.0:1789448346.098591:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448346.098594:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59a00, rc 0) 00000100:00100000:1.0:1789448346.098689:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+39:10376:x1876372295287680:12345-192.168.202.54@tcp:101:stat.0 Request processed in 23661us (24230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448346.098718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789448346.168447:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.168530:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295288320 00000100:00100000:2.0:1789448346.168539:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295288320 00000100:00100000:2.0:1789448346.168603:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:2.0:1789448346.168615:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+39:10382:x1876372295288320:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:2.0:1789448346.168675:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448346.168713:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed17 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.168732:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448346.168741:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448346.169140:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.169155:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.169165:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448346.169310:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789448346.169340:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002feb6583 reply state 000000003be63500 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448346.169350:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448346.169469:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+41:10382:x1876372295288320:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 856us (1028us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789448346.169477:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000020:00080000:2.0:1789448346.169489:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789448346.171545:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171563:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171571:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171593:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.171608:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171617:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171633:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448346.171636:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448346.171641:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.171647:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9baf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448346.329983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448346.330357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295288448 00000100:00100000:3.0:1789448346.330367:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295288448 00000100:00100000:3.0:1789448346.330432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789448346.330442:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+40:10396:x1876372295288448:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1789448346.330466:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448346.330487:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed1e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330827:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330845:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330865:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330888:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330935:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.330942:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331015:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331020:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331024:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448346.331156:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789448346.331161:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448346.331184:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331196:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331205:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331212:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331257:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331264:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.331268:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331277:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331288:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448346.331290:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448346.331294:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331299:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9bbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331308:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331311:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331315:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331319:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.331320:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331330:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331335:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448346.331338:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448346.331340:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331346:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331378:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331391:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.331396:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448346.331397:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448346.331399:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26800, rc 0) 00000100:00100000:3.0:1789448346.332176:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+41:10396:x1876372295288448:12345-192.168.202.54@tcp:101:stat.0 Request processed in 1417us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448346.332185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1789448346.429971:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448346.435611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295288704 00000100:00100000:3.0:1789448346.435625:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295288704 00000100:00100000:3.0:1789448346.435716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1789448346.435732:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+41:10406:x1876372295288704:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448346.435766:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448346.435786:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed25 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448346.435878:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789448346.435992:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed25 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.436006:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:3.0:1789448346.436009:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448346.436013:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed25 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.436026:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448346.436088:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+42:10406:x1876372295288704:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 357us (6127us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789448346.436094:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:1.0:1789448346.440881:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.441006:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295288960 00000100:00100000:2.0:1789448346.441014:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295288960 00000100:00100000:2.0:1789448346.441061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789448346.441068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+42:10406:x1876372295288960:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448346.441319:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+43:10406:x1876372295288960:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 251us (446us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789448346.441324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1789448346.518064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448346.518196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295289216 00000100:00100000:1.0:1789448346.518205:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295289216 00000100:00100000:1.0:1789448346.518328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1789448346.518348:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+43:10412:x1876372295289216:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448346.518372:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448346.518392:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9be0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed2c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.518492:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.518503:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.518517:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.518543:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.518552:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 44 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448346.518561:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317341312:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448346.518637:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448346.523887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448346.523926:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317341312:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448346.523960:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448346.523975:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295289344 00000100:00100000:3.0:1789448346.523982:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295289344 00010000:00010000:3.0:1789448346.524018:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 45 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448346.524082:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:3.0:1789448346.524089:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+45:2350:x1876372295289344:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448346.524100:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448346.524105:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 45 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524130:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 45 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524146:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed1e expref: 45 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524179:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448346.524184:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524195:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524203:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.524265:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448346.524318:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+44:2350:x1876372295289344:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 229us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448346.524326:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:2.0:1789448346.524331:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.524461:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448346.524483:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789448346.524631:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9be0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.524648:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.524655:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448346.524657:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789448346.524660:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58600, rc 0) 00000100:00100000:2.0:1789448346.524684:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+44:10412:x1876372295289216:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6348us (6630us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789448346.524691:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:0.0:1789448346.529462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448346.529544:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295289600 00000100:00100000:3.0:1789448346.529554:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295289600 00000100:00100000:3.0:1789448346.529614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1789448346.529624:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+44:10412:x1876372295289600:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:3.0:1789448346.529897:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.529915:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.529941:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789448346.529992:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789448346.530016:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469b18ee reply state 000000000a91e94a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448346.530025:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789448346.530108:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10412:x1876372295289600:12345-192.168.202.54@tcp:36:bash.0 Request processed in 485us (657us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789448346.530116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000020:00080000:3.0:1789448346.530121:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448346.535853:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535871:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535880:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535886:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448346.535891:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535899:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535932:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448346.535935:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448346.535941:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.535948:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9bf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448346.541329:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448346.541562:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295289728 00000100:00100000:3.0:1789448346.541573:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295289728 00000100:00100000:3.0:1789448346.541654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1789448346.541665:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+46:10412:x1876372295289728:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789448346.541706:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448346.541732:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed33 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.541820:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.541834:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.541842:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.541897:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.541909:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 47 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448346.541923:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317341440:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448346.542038:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448346.546880:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317341440:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448346.546911:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448346.547658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.547832:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295289856 00000100:00100000:2.0:1789448346.547849:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295289856 00010000:00010000:2.0:1789448346.547887:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 48 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448346.547929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:2.0:1789448346.547939:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+48:2351:x1876372295289856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448346.547954:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448346.547961:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 48 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.547973:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 48 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.547996:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9be7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed2c expref: 48 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.548013:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448346.548017:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.548027:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.548034:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.548066:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448346.548330:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+47:2351:x1876372295289856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 392us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448346.548348:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00010000:00010000:0.0:1789448346.548775:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.548784:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448346.548835:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789448346.548840:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448346.548868:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.548901:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed33 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.548918:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed33 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448346.548926:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448346.548929:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448346.548941:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26e00, rc 0) 00000100:00100000:0.0:1789448346.548974:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+46:10412:x1876372295289728:12345-192.168.202.54@tcp:101:bash.0 Request processed in 7311us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448346.548980:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:0.0:1789448346.553917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.553985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295290112 00000100:00100000:2.0:1789448346.553994:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295290112 00000100:00100000:2.0:1789448346.554039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789448346.554046:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+46:10412:x1876372295290112:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789448346.554300:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10412:x1876372295290112:12345-192.168.202.54@tcp:35:bash.0 Request processed in 252us (391us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789448346.554307:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1789448346.654604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.655253:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295290368 00000100:00100000:2.0:1789448346.655263:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295290368 00000100:00100000:2.0:1789448346.655393:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:2.0:1789448346.655405:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10422:x1876372295290368:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448346.655430:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448346.655451:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed3a expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448346.655537:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789448346.655660:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed3a expref: 49 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.656131:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:2.0:1789448346.656135:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448346.656141:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed3a expref: 49 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.656160:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3a00, rc 0) 00000100:00100000:2.0:1789448346.656421:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+48:10422:x1876372295290368:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1017us (1824us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789448346.656429:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789448346.660990:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.661087:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295290496 00000100:00100000:2.0:1789448346.661098:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295290496 00000100:00100000:2.0:1789448346.661192:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789448346.661202:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+48:10422:x1876372295290496:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789448346.661310:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661330:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661481:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661498:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661505:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661513:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661599:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661608:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661744:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448346.661800:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661813:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661820:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661827:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661833:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448346.661837:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661844:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661854:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:2.0:1789448346.661857:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448346.661863:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661869:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661882:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661887:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661911:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661917:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448346.661919:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661925:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661932:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d6311a00) 00010000:00010000:2.0:1789448346.661935:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448346.661938:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661943:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661958:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661963:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661968:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661973:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448346.661976:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661992:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.661999:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:2.0:1789448346.662002:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448346.662005:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448346.662010:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448346.662091:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+48:10422:x1876372295290496:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 888us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448346.662099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789448346.667627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.667816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295290752 00000100:00100000:2.0:1789448346.667826:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295290752 00000100:00100000:2.0:1789448346.667876:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789448346.667885:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+48:10422:x1876372295290752:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448346.668125:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10422:x1876372295290752:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 240us (519us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789448346.668133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00010000:00010000:3.0:1789448346.777580:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448346.779262:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448346.779360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291008 00000100:00100000:3.0:1789448346.779369:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291008 00000100:00100000:3.0:1789448346.779441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1789448346.779452:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10425:x1876372295291008:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448346.779474:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448346.779494:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed41 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779576:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779590:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779619:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779634:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779642:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779649:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779791:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779799:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779806:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448346.779815:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789448346.779915:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779923:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779930:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779935:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.779945:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779953:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779964:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448346.779967:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448346.779972:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779978:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779991:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.779997:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780003:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780007:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.780009:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780014:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780020:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448346.780022:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448346.780031:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780036:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780073:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed41 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780086:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed41 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.780094:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448346.780096:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448346.780099:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27800, rc 0) 00000100:00100000:3.0:1789448346.780152:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10425:x1876372295291008:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 702us (937us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789448346.780160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1789448346.812125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448346.812188:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448346.812467:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291136 00000100:00100000:1.0:1789448346.812477:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291136 00000100:00100000:1.0:1789448346.812555:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789448346.812567:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+51:2350:x1876372295291136:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448346.812584:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448346.812610:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed41 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448346.812629:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:1.0:1789448346.812634:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448346.812702:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+50:2350:x1876372295291136:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 129us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448346.812710:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789448346.815565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291264 00000100:00100000:3.0:1789448346.815581:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291264 00000100:00100000:3.0:1789448346.815670:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:3.0:1789448346.815681:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+50:10425:x1876372295291264:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789448346.815766:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815783:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815794:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815839:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815847:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815855:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815861:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448346.815865:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815872:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815883:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448346.815886:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448346.815891:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448346.815898:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448346.815978:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+50:10425:x1876372295291264:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 299us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448346.815986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789448346.837026:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448346.837242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291520 00000100:00100000:2.0:1789448346.837253:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291520 00000100:00100000:2.0:1789448346.837316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789448346.837327:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+50:10425:x1876372295291520:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448346.837934:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10425:x1876372295291520:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 607us (915us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789448346.837957:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1789448347.149140:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.149294:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291776 00000100:00100000:3.0:1789448347.149306:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291776 00000100:00100000:3.0:1789448347.149380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1789448347.149406:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10443:x1876372295291776:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:3.0:1789448347.149434:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.149456:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.149558:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.149573:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.149585:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448347.149598:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789448347.149868:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed48 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.149887:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed48 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.149895:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.149898:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789448347.149901:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26a00, rc 0) 00000100:00100000:3.0:1789448347.149971:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10443:x1876372295291776:12345-192.168.202.54@tcp:101:cat.0 Request processed in 567us (840us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789448347.149979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:2.0:1789448347.170142:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.170271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295291904 00000100:00100000:3.0:1789448347.170280:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295291904 00000100:00100000:3.0:1789448347.170352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1789448347.170362:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10444:x1876372295291904:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448347.170388:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.170408:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed4f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170465:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170485:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448347.170609:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789448347.170612:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448347.170630:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170656:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed4f expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170675:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed4f expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.170683:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448347.170686:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448347.170702:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27600, rc 0) 00000100:00100000:3.0:1789448347.171471:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10444:x1876372295291904:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1105us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.171488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1789448347.177481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.177618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292288 00000100:00100000:3.0:1789448347.177630:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292288 00000100:00100000:3.0:1789448347.177752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1789448347.177763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10444:x1876372295292288:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789448347.178079:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10444:x1876372295292288:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 317us (604us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789448347.178087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789448347.182715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.182854:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292416 00000100:00100000:3.0:1789448347.182864:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292416 00000100:00100000:3.0:1789448347.182927:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789448347.182936:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10444:x1876372295292416:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:3.0:1789448347.182952:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789448347.182975:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed33 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.182998:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed48 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.183012:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecf4 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.183022:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.183033:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448347.183086:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10444:x1876372295292416:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 152us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.183111:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789448347.192092:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448347.192567:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292544 00000100:00100000:2.0:1789448347.192577:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292544 00000100:00100000:2.0:1789448347.192637:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:2.0:1789448347.192646:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10444:x1876372295292544:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:2.0:1789448347.192785:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.192799:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.192809:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448347.193021:0:7825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448347.193154:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789448347.193256:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789448347.193371:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10444:x1876372295292544:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 725us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448347.193377:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1789448347.228121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.228201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292672 00000100:00100000:3.0:1789448347.228212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292672 00000100:00100000:3.0:1789448347.228320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1789448347.228334:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10446:x1876372295292672:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448347.228352:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.228370:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228423:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228445:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228458:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228472:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228479:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228485:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228573:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228593:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228597:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448347.228639:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789448347.228643:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448347.228662:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228674:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228683:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228700:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228707:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228720:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.228724:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228730:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228739:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448347.228742:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.228750:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228754:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9c88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228763:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228766:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228770:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228773:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.228774:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228777:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228781:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.228782:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.228784:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228787:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228807:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228822:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.228827:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:3.0:1789448347.228829:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448347.228830:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27400, rc 0) 00000100:00100000:3.0:1789448347.228884:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10446:x1876372295292672:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 557us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.228888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000040:00080000:3.0:1789448347.353471:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448347.353483:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448347.353559:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789448347.353565:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448347.353705:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317341568:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789448347.353864:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448347.370054:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317341568:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789448347.372984:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448347.374322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292800 00000100:00100000:2.0:1789448347.374347:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292800 00000100:00100000:2.0:1789448347.374418:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1789448347.374430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295292800:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789448347.374533:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295292800:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 105us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448347.374558:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789448347.388669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448347.388827:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295292928 00000100:00100000:2.0:1789448347.388837:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295292928 00000100:00100000:2.0:1789448347.389817:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1789448347.389836:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295292928:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789448347.389879:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789448347.390908:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295292928:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 1073us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448347.390919:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:1.0:1789448347.426193:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317342080:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426366:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789448347.426373:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317341696:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426425:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317342208:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426494:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317341824:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426545:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317342336:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426578:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448347.426582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317341952:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.426647:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317342080 00000100:00100000:1.0:1789448347.426655:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317342080 00000100:00100000:1.0:1789448347.426711:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317342336 00000100:00100000:1.0:1789448347.426722:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317342336 00000100:00100000:1.0:1789448347.426746:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789448347.426754:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317342080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426805:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317342080:12345-0@lo:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.426812:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789448347.426828:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789448347.426833:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317342336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.426862:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317342336:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.426868:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789448347.427063:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317341696 00000100:00100000:1.0:1789448347.427068:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317341696 00000100:00100000:1.0:1789448347.427095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789448347.427101:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3304:x1876372317341696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427141:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3304:x1876372317341696:12345-0@lo:400:kworker.0 Request processed in 40us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.427148:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789448347.427189:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317341696:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427204:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317342080:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427262:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317342336:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427282:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317342208 00000100:00100000:1.0:1789448347.427286:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317342208 00000100:00100000:1.0:1789448347.427310:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317341824 00000100:00100000:1.0:1789448347.427312:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317341824 00000100:00100000:1.0:1789448347.427322:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317341952 00000100:00100000:1.0:1789448347.427338:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317341952 00000100:00100000:1.0:1789448347.427354:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789448347.427360:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317342208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427394:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317342208:12345-0@lo:400:kworker.0 Request processed in 34us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.427399:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789448347.427421:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317342208:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427436:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789448347.427442:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317341824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.427471:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317341824:12345-0@lo:400:kworker.0 Request processed in 29us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.427477:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789448347.428033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789448347.428044:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448347.428083:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317341952:12345-0@lo:400:kworker.0 Request processed in 42us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.428089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789448347.428569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448347.428590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295293056 00000100:00100000:0.0:1789448347.428597:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295293056 00000100:00100000:0.0:1789448347.428630:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:0.0:1789448347.428637:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295293056:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789448347.428720:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428736:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428750:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428784:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428792:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428799:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428826:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428835:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428841:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448347.428879:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789448347.428893:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448347.428907:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428917:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428924:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428931:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428947:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448347.428952:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428960:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428972:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:0.0:1789448347.428975:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448347.428980:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428985:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9c9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.428998:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429004:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429009:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429013:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448347.429016:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429022:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429041:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97d9d0030e00) 00010000:00010000:0.0:1789448347.429043:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448347.429046:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429053:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9ca4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429067:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429074:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429079:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429084:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448347.429087:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429093:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429101:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:0.0:1789448347.429103:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448347.429106:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.429111:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.429189:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295293056:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 551us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448347.429195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00080000:2.0:1789448347.429613:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448347.429620:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448347.429622:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448347.429700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317341824:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.429748:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317341952:0@lo:400:kworker.0 00000100:00100000:1.0:1789448347.432472:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.432514:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295293312 00000100:00100000:1.0:1789448347.432526:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295293312 00000100:00100000:1.0:1789448347.432578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:1.0:1789448347.432587:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10457:x1876372295293312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448347.432614:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448347.432636:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9cb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed5d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.432792:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.432806:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.432819:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448347.432830:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789448347.432980:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.432988:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.432994:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433000:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448347.433010:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433019:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:1.0:1789448347.433035:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448347.433039:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433045:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9cb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433092:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9cb2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed5d expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433103:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:1.0:1789448347.433105:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448347.433109:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9cb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed5d expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.433119:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58a00, rc 0) 00000100:00100000:1.0:1789448347.433177:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295293312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 590us (714us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789448347.433185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789448347.453675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.455056:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295293440 00000100:00100000:1.0:1789448347.455073:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295293440 00000100:00100000:1.0:1789448347.455132:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789448347.455142:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295293440:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789448347.455191:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789448347.455314:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295293440:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 173us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.455322:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789448347.491291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.491433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295293696 00000100:00100000:3.0:1789448347.491443:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295293696 00000100:00100000:3.0:1789448347.491501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1789448347.491512:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295293696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.491548:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.491552:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789448347.491583:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed4f expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.491600:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448347.491604:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448347.491617:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9cc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789448347.492344:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789448347.492609:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9cce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.492624:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.492636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.492711:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9cc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed64 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.492727:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed64 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.492736:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448347.492739:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448347.492749:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26e00, rc 0) 00000100:00100000:3.0:1789448347.492829:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10457:x1876372295293696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1319us (1548us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789448347.492838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1789448347.496785:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.496824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295293952 00000100:00100000:3.0:1789448347.496837:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295293952 00000100:00100000:3.0:1789448347.496893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1789448347.496903:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10457:x1876372295293952:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.496962:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448347.496990:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9cce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed64 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497007:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448347.497017:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448347.497037:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497050:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497059:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497071:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497097:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497319:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497326:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497333:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497338:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.497343:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497350:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497360:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448347.497363:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.497367:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497372:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9cdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497380:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497385:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497398:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497403:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.497405:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497411:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497419:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x12b78ab9 (ffff97d9d0a5c600) 00010000:00010000:3.0:1789448347.497421:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.497424:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.497429:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465f9ce3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x12b78ab9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.497508:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295293952:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 605us (733us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448347.497515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1789448347.506315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.506349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294080 00000100:00100000:3.0:1789448347.506359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294080 00000100:00100000:3.0:1789448347.506410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1789448347.506420:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10457:x1876372295294080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.506442:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.506467:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9cea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed6b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506531:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506542:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506638:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506655:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.506665:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.506668:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448347.506671:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26800, rc 0) 00000100:00100000:3.0:1789448347.506754:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10457:x1876372295294080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 335us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.506761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:0.0:1789448347.514000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.514487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294336 00000100:00100000:3.0:1789448347.514498:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294336 00000100:00100000:3.0:1789448347.514559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1789448347.514570:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10457:x1876372295294336:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.514654:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.514682:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.514706:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448347.515533:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789448347.515545:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369218326993ns, next at 370218324637ns, rc = 0 00000004:00010000:3.0:1789448347.515631:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004738014a reply state 00000000373f8426 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.515641:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789448347.515762:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10457:x1876372295294336:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1192us (1770us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789448347.515770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:3.0:1789448347.530080:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530111:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530120:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530126:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.530132:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530142:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530309:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.530312:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789448347.530319:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.530326:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cf8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448347.549156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.550344:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294464 00000100:00100000:3.0:1789448347.550470:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294464 00000100:00100000:3.0:1789448347.550549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:3.0:1789448347.550560:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10457:x1876372295294464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.550736:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448347.550758:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.550822:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.550838:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.550858:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.550861:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448347.550865:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448347.550919:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10457:x1876372295294464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 361us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.550937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789448347.557065:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000001:00080000:3.0:1789448347.557260:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000001:00080000:3.0:1789448347.557274:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:3.0:1789448347.557287:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789448347.557304:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9d13a7900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789448347.557308:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9e7a69600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9d13a7a80 00000020:00080000:3.0:1789448347.557311:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9e7a69800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9d1027400 00000100:00100000:1.0:1789448347.558456:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294592 00000100:00100000:1.0:1789448347.558470:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294592 00000100:00100000:1.0:1789448347.558523:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789448347.558531:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876372295294592:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789448347.558566:0:10266:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:1.0:1789448347.558681:0:10266:0:(genops.c:1384:class_connect()) connect: client a7263448-abed-44d6-a5e0-4aa81ee22270, cookie 0xe29566c2465f9d06 00002000:00100000:1.0:1789448347.558704:0:10266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7263448-abed-44d6-a5e0-4aa81ee22270/ffff97d9fab6b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448347.558728:0:10266:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789448347.558949:0:10266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448347.558983:0:10266:0:(import.c:65:import_set_state_nolock()) ffff97d9fab6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448347.559056:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2347:x1876372295294592:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 Request processed in 523us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.559064:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000001:00080000:3.0:1789448347.559702:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:3.0:1789448347.559758:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1789448347.559894:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1789448347.559970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:3.0:1789448347.559972:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789448347.559989:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317342464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789448347.560041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.560459:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317342464 00000100:00100000:1.0:1789448347.560467:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317342464 00000100:00100000:1.0:1789448347.560497:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789448347.560504:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317342464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789448347.560528:0:10266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789448347.560564:0:10266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa8d098, atime: 0x6aa8d099, ctime: 0x6aa8d098, blocks: 0xb 00010000:00010000:1.0:1789448347.560572:0:10266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.560599:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1789448347.560604:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448347.560610:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.560627:0:10266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.560648:0:10266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.560657:0:10266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.560676:0:10266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448347.561231:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448347.561240:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.561249:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448347.561253:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.561262:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.561282:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.561289:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf41b7b/0xe29566c2465f9d0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.561316:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448347.561318:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448347.561320:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448347.561570:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876372317342464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1064us (1527us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789448347.561578:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1789448347.561711:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9d0103100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789448347.561717:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d0103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317342464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789448347.570160:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448347.571132:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294720 00000100:00100000:2.0:1789448347.571145:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294720 00000100:00100000:1.0:1789448347.575769:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1789448347.575784:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:0:x1876372295294720:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789448347.576376:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448347.676386:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:0:x1876372295294720:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 100594us (106227us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789448347.676401:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000001:00080000:1.0:1789448347.676436:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789448347.676455:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000100:00100000:2.0:1789448347.680015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.680109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295294976 00000100:00100000:1.0:1789448347.680120:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295294976 00000100:00100000:1.0:1789448347.680183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789448347.680193:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10457:x1876372295294976:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789448347.680450:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10457:x1876372295294976:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 257us (442us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789448347.680458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789448347.682426:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.683070:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295295232 00000100:00100000:3.0:1789448347.683081:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295295232 00000100:00100000:3.0:1789448347.683137:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:3.0:1789448347.683148:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10457:x1876372295295232:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789448347.683278:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10457:x1876372295295232:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 131us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.683286:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1789448347.687372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448347.687454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295295360 00000100:00100000:0.0:1789448347.687463:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295295360 00000100:00100000:0.0:1789448347.687528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:0.0:1789448347.687539:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10457:x1876372295295360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448347.687558:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448347.687704:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed79 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687789:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687804:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687816:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448347.687853:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448347.687871:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687896:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed79 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687927:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed79 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.687935:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448347.687938:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789448347.687941:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448347.687990:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10457:x1876372295295360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 453us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448347.687997:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:0.0:1789448347.693076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.693160:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295295488 00000100:00100000:1.0:1789448347.693171:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295295488 00000100:00100000:1.0:1789448347.693257:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789448347.693269:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295295488:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448347.693285:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448347.693306:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed80 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448347.693333:0:10266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d09b, blocks: 0x1 00010000:00010000:1.0:1789448347.693355:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1789448347.693360:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448347.693368:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 6 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.693387:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 6 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.693400:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58600, rc 0) 00000100:00100000:1.0:1789448347.693468:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295295488:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.693474:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:0.0:1789448347.696505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.696701:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295295744 00000100:00100000:3.0:1789448347.696712:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295295744 00000100:00100000:3.0:1789448347.696775:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1789448347.696785:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10457:x1876372295295744:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789448347.696951:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10457:x1876372295295744:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 167us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.696959:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1789448347.701892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.701986:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295295872 00000100:00100000:1.0:1789448347.701996:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295295872 00000100:00100000:1.0:1789448347.702061:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789448347.702073:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:10457:x1876372295295872:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448347.702092:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448347.702112:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed87 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.702145:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 7 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.702154:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448347.702159:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448347.702164:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.702196:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 7 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.702210:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 7 pid: 10266 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.702246:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317342592:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448347.702340:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448347.704303:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.704335:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296000 00000100:00100000:1.0:1789448347.704343:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296000 00010000:00010000:1.0:1789448347.704384:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 8 pid: 10266 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.704417:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1789448347.704426:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295296000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448347.704440:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448347.704465:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 8 pid: 10266 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.704479:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 8 pid: 10266 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.704504:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448347.704753:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9d22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed80 expref: 8 pid: 10266 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.704773:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317342592:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448347.704809:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448347.704819:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.704830:0:7613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.710576:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.710623:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae59a00, rc 0) 00000100:00100000:3.0:1789448347.710708:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:10457:x1876372295295872:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 8636us (8823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.710718:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00010000:00010000:1.0:1789448347.711381:0:7613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.711414:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317342720:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448347.711485:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448347.715809:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317342720:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789448347.715839:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448347.715892:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295296000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11466us (11596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.715901:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789448347.716018:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.717193:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296128 00000100:00100000:1.0:1789448347.717205:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296128 00002000:00100000:1.0:1789448347.717272:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97d9eac8fb80 x1876372295296128/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:208/0 lens 504/0 e 0 to 0 dl 1789448358 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789448347.717282:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9eac8fb80 with x1876372295296128 ext(0->8) 00002000:00010000:1.0:1789448347.717288:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9eac8fb80 00000100:00100000:1.0:1789448347.717311:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1789448347.717321:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295296128:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789448347.721250:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295296128:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 1733us (3034us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789448347.721266:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:1.0:1789448347.721291:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97d9eac8fb80 x1876372295296128/t4294967302(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:208/0 lens 504/448 e 0 to 0 dl 1789448358 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789448347.721302:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9eac8fb80 with x1876372295296128 ext(0->8) 00002000:00010000:1.0:1789448347.721308:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9eac8fb80 00000100:00100000:3.0:1789448347.722608:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.722787:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296256 00000100:00100000:1.0:1789448347.722800:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296256 00000100:00100000:1.0:1789448347.722868:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:1.0:1789448347.722878:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10457:x1876372295296256:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789448347.788072:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789448347.788117:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1789448347.788129:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789448347.788147:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789448347.788157:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789448347.788294:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317342848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789448347.788360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448347.788435:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317342848 00000100:00100000:1.0:1789448347.788442:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317342848 00000100:00100000:1.0:1789448347.788487:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448347.788495:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317342848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789448347.790036:0:10266:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789448347.790044:0:10266:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789448347 00002000:00010000:1.0:1789448347.790047:0:10266:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789448347.790050:0:10266:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789448347 -> 1789448347 00002000:00010000:1.0:1789448347.790052:0:10266:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789448347.790133:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317342848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1635us (1769us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789448347.790144:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448347.790294:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10457:x1876372295296256:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 67415us (67697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.790303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000004:00080000:3.0:1789448347.791133:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9f550b800/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789448347.791143:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317342848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789448347.792382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.792467:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296384 00000100:00100000:1.0:1789448347.792476:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296384 00000100:00100000:1.0:1789448347.792528:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:1.0:1789448347.792540:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295296384:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789448347.805146:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448347.865288:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295296384:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 72731us (72892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.865323:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000001:00080000:1.0:1789448347.865365:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789448347.865373:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789448347.882480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.887753:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296640 00000100:00100000:3.0:1789448347.887767:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296640 00000100:00100000:0.0:1789448347.888060:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:0.0:1789448347.888071:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10457:x1876372295296640:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789448347.888123:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448347.888160:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed79 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.888177:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448347.888182:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448347.888211:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.888252:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.888285:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448347.888947:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da88f19d reply state 0000000047fedf63 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.888957:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448347.889201:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10457:x1876372295296640:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1130us (6729us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789448347.889209:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1789448347.901027:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1789448347.901495:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901643:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901653:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901659:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.901672:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901691:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901710:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.901713:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.901718:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.901726:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9d30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.901848:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295296768 00000100:00100000:1.0:1789448347.901858:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295296768 00000100:00100000:1.0:1789448347.901950:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1789448347.901960:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295296768:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789448347.902212:0:10266:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789448347.902401:0:10266:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789448347 -> 1789448346 00002000:00010000:1.0:1789448347.902405:0:10266:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789448345 00002000:00010000:1.0:1789448347.902407:0:10266:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789448347 -> 1789448346 00002000:00010000:1.0:1789448347.902409:0:10266:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789448347.902473:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295296768:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 514us (1455us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789448347.902481:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1789448347.908336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448347.908427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297024 00000100:00100000:2.0:1789448347.908438:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297024 00000100:00100000:2.0:1789448347.908495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789448347.908506:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10457:x1876372295297024:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789448347.908576:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.908593:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.908603:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.908637:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.908650:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 13 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448347.908664:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317342976:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448347.908765:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f53683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448347.911348:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317342976:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448347.911376:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.920856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448347.921163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297152 00000100:00100000:0.0:1789448347.921174:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297152 00010000:00010000:0.0:1789448347.921214:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.923578:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789448347.923599:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2351:x1876372295297152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448347.923618:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448347.923629:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923646:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923669:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465f9cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed6b expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923716:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448347.923723:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923733:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923742:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.923777:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448347.923838:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:2351:x1876372295297152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 246us (2993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448347.923845:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00010000:00010000:1.0:1789448347.924191:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924200:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924695:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924704:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924776:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924794:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448347.924798:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924806:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924818:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:1.0:1789448347.924821:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789448347.924825:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.924830:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9d37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.924894:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+12:10457:x1876372295297024:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 16387us (16564us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789448347.924903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789448347.938037:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448347.938066:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317343104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448347.938136:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448347.938499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.938528:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297280 00000100:00100000:3.0:1789448347.938536:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297280 00000100:00100000:3.0:1789448347.938580:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:3.0:1789448347.938590:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295297280:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.938634:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.938655:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.938664:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448347.938669:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448347.938674:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.940278:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.940302:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 7 pid: 6672 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.940317:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317343232:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448347.940393:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448347.941884:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317343104 00000100:00100000:1.0:1789448347.941896:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317343104 00000100:00100000:1.0:1789448347.942027:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448347.942038:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317343104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448347.942063:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789448347.943335:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317343104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.943349:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448347.943416:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789448347.943422:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9f550b800, transno 4294967303 00000100:00100000:1.0:1789448347.943464:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317343104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448347.950158:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317343232:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448347.950187:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.954310:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.954549:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297408 00000100:00100000:1.0:1789448347.954559:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297408 00010000:00010000:1.0:1789448347.954598:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 8 pid: 6672 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.954678:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:1.0:1789448347.954697:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295297408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448347.954720:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448347.954745:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 8 pid: 6672 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.954759:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 8 pid: 6672 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.954782:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822e1349/0xe29566c2465f9d29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed87 expref: 8 pid: 6672 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.954799:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448347.954803:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448347.954809:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.954819:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.954851:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448347.954869:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.954879:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.954903:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.954909:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295297408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 213us (607us total) trans 0 rc 0/0 00010000:00010000:2.0:1789448347.954912:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.954916:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00010000:00010000:2.0:1789448347.954920:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.954926:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448347.954930:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.954938:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.954953:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448347.955594:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d65c5d68/0xe29566c2465f9d3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448347.955648:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295297280:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 17058us (17150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448347.955656:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789448347.958680:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.958848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297664 00000100:00100000:3.0:1789448347.958858:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297664 00000100:00100000:3.0:1789448347.958945:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:3.0:1789448347.958956:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+12:10457:x1876372295297664:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789448347.959036:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.959054:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.959068:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.959333:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.959346:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.959355:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.959392:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.959408:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 13 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.959423:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317343360:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448347.959498:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c55c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448347.962917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448347.962977:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297792 00000100:00100000:3.0:1789448347.962987:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297792 00010000:00010000:3.0:1789448347.963025:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.963071:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1789448347.963087:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2350:x1876372295297792:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448347.963101:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448347.963108:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.963123:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 14 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.963153:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:3.0:1789448347.963159:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.963168:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.963177:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.963196:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448347.963268:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2350:x1876372295297792:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 182us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448347.963275:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00010000:00010000:0.0:1789448347.964024:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465f9cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed72 expref: 13 pid: 5834 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.964039:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317343360:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448347.964058:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.964075:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.964081:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448347.964362:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789448347.965573:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789448347.965696:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789448347.965845:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f547b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876372317343488:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789448347.965912:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448347.965988:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448347.967842:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317343488 00000100:00100000:1.0:1789448347.967856:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317343488 00000100:00100000:1.0:1789448347.967941:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448347.967952:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876372317343488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789448347.968075:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876372317343488:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448347.968082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448347.968164:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f547b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876372317343488:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789448347.968671:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789448347.968765:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f547b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876372317343616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789448347.968805:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448347.968830:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448347.968866:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317343616 00000100:00100000:0.0:1789448347.968871:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317343616 00000100:00100000:0.0:1789448347.968890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448347.968897:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876372317343616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789448347.969055:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876372317343616:12345-0@lo:1000:mdt00_000.0 Request processed in 157us (248us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789448347.969062:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448347.969093:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f547b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876372317343616:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789448347.969121:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969136:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969143:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969148:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448347.969153:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969161:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969176:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9d0a5cb00) 00010000:00010000:0.0:1789448347.969179:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448347.969185:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969191:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9d4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969244:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969251:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969257:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969262:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448347.969270:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969276:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969285:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:0.0:1789448347.969288:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448347.969291:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969297:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465f9c7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969319:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969334:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969343:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969369:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448347.969383:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 16 pid: 5835 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.969395:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f547a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317343744:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448347.969451:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448347.975531:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f547a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317343744:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448347.975570:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448347.975937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.976018:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295297920 00000100:00100000:1.0:1789448347.976030:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295297920 00010000:00010000:1.0:1789448347.976142:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 17 pid: 5835 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.976183:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1789448347.976193:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+17:2351:x1876372295297920:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448347.976208:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448347.976247:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 17 pid: 5835 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976261:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 17 pid: 5835 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976352:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465f9c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed56 expref: 17 pid: 5835 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976365:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:1.0:1789448347.976370:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976380:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976388:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.976413:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448347.976455:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.976459:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+16:2351:x1876372295297920:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 267us (524us total) trans 0 rc 0/0 00010000:00010000:3.0:1789448347.976463:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976474:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448347.976480:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00010000:00010000:3.0:1789448347.976488:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976494:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976500:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.976504:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976511:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976521:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:3.0:1789448347.976523:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448347.976526:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976532:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9d53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976543:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976549:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976555:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976559:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448347.976568:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976574:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976582:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311a00) 00010000:00010000:3.0:1789448347.976585:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448347.976588:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.976594:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448347.976807:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10457:x1876372295297664:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 17852us (18137us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789448347.976816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000020:00080000:3.0:1789448347.976820:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789448347.976876:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448347.976882:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448347.976908:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789448347.976913:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789448347.978874:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448347.978963:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295298176 00000100:00100000:1.0:1789448347.978972:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295298176 00000100:00100000:1.0:1789448347.979020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789448347.979028:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10457:x1876372295298176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789448347.979940:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789448347.980041:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789448347.980100:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980116:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980128:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980136:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980142:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980149:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448347.980172:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448347.980203:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448347.980210:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.980238:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448347.980243:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.980250:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.980263:0:8432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97d9e0bd6000) 00010000:00010000:3.0:1789448347.980266:0:8432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789448347.980276:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.980283:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9d5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448347.980299:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448347.980301:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448347.980303:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448347.980320:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10457:x1876372295298176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1290us (1451us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789448347.980329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000020:00080000:1.0:1789448347.980334:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789448348.274025:0:11989:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448348.274035:0:11989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448348.274073:0:11989:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789448348.274080:0:11989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789448348.415061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.415168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295298432 00000100:00100000:3.0:1789448348.415181:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295298432 00000100:00100000:3.0:1789448348.415408:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1789448348.415423:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:10467:x1876372295298432:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448348.415456:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448348.415483:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.415618:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.416665:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789448348.416992:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448348.417334:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448348.417362:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789448348.417546:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed8e expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.417565:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed8e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.417581:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448348.417585:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789448348.417590:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26a00, rc 0) 00000100:00100000:3.0:1789448348.417753:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10467:x1876372295298432:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 2335us (2709us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789448348.417762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1789448348.422596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.423406:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295298560 00000100:00100000:3.0:1789448348.423424:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295298560 00000100:00100000:2.0:1789448348.423755:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1789448348.423770:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10467:x1876372295298560:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789448348.423936:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.423960:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.423976:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.423996:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424005:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424012:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424555:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424568:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424577:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448348.424650:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424667:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424674:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424691:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424698:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448348.424703:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424712:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424728:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:2.0:1789448348.424732:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448348.424738:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424751:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9d76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424765:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424770:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424776:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424781:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448348.424785:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424791:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424798:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d6311200) 00010000:00010000:2.0:1789448348.424801:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448348.424804:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424810:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424829:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424835:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424847:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424853:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448348.424855:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.424861:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.425306:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d6311300) 00010000:00010000:2.0:1789448348.425310:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448348.425314:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.425321:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465f9d84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.425510:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10467:x1876372295298560:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1738us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448348.425522:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1789448348.441401:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448348.441432:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317343872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448348.441551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448348.445597:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317343872 00000100:00100000:1.0:1789448348.445618:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317343872 00000100:00100000:1.0:1789448348.445754:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448348.445766:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317343872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448348.445814:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448348.445943:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317343872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448348.445949:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448348.446026:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317343872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448348.467323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.467373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295298816 00000100:00100000:3.0:1789448348.467439:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295298816 00000100:00100000:3.0:1789448348.467520:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1789448348.467535:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+19:10470:x1876372295298816:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448348.467566:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448348.467593:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed95 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467710:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467728:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467742:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467760:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467777:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.467782:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.468094:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.468100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.468105:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448348.468114:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789448348.468206:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.468212:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477617:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477627:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.477634:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477646:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477703:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448348.477706:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448348.477713:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477721:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9d92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477739:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477747:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477754:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477759:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.477763:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477769:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5c600) 00010000:00010000:3.0:1789448348.477778:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448348.477781:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477787:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477882:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9d8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477900:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.477908:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448348.477910:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448348.477913:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27600, rc 0) 00000100:00100000:3.0:1789448348.478012:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10470:x1876372295298816:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 10479us (10704us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789448348.478022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1789448348.488951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.493182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295298944 00000100:00100000:3.0:1789448348.493209:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295298944 00000100:00100000:3.0:1789448348.493328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:3.0:1789448348.493342:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10470:x1876372295298944:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789448348.493437:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493459:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493474:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493511:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493543:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493552:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493560:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.493565:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493575:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493590:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448348.493594:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448348.493600:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.493607:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448348.493964:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10470:x1876372295298944:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 623us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448348.493974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:2.0:1789448348.497023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.497115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295299200 00000100:00100000:3.0:1789448348.497132:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295299200 00000100:00100000:3.0:1789448348.497580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789448348.497661:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10470:x1876372295299200:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448348.498033:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:10470:x1876372295299200:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 440us (1025us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789448348.499822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1789448348.546126:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.546287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295299456 00000100:00100000:1.0:1789448348.546301:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295299456 00000100:00100000:1.0:1789448348.546369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:1.0:1789448348.546381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:9999:x1876372295299456:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448348.546413:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448348.546442:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9db5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ed9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.546587:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.546601:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.546609:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.546711:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.546728:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 23 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448348.546746:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317344000:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448348.546894:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448348.549158:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317344000:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448348.549200:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.549455:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.549623:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295299584 00000100:00100000:3.0:1789448348.549633:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295299584 00010000:00010000:3.0:1789448348.549933:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 24 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448348.549986:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789448348.549997:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+24:2350:x1876372295299584:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448348.550015:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448348.550024:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 24 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550036:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 24 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550058:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed95 expref: 24 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550074:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448348.550079:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550088:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550094:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.550139:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.550145:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448348.550148:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448348.550172:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1789448348.550243:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+23:2350:x1876372295299584:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 222us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448348.550251:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00010000:00010000:1.0:1789448348.550403:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58600/0xe29566c2465f9db5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.550422:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.550430:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:1.0:1789448348.550433:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789448348.550435:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58a00, rc 0) 00000100:00100000:1.0:1789448348.550465:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:9999:x1876372295299456:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4085us (4352us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789448348.550473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1789448348.552828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448348.552904:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295299840 00000100:00100000:2.0:1789448348.552917:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295299840 00000100:00100000:2.0:1789448348.552988:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:2.0:1789448348.553001:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+23:9999:x1876372295299840:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1789448348.553377:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.553393:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.553404:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448348.553450:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789448348.553468:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2ac3a0d reply state 00000000b88e97f5 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.553475:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789448348.553506:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789448348.553603:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+27:9999:x1876372295299840:12345-192.168.202.54@tcp:36:bash.0 Request processed in 604us (787us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789448348.553611:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000020:00080000:2.0:1789448348.553617:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789448348.554806:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554819:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554824:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554828:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.554832:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554838:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554851:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:3.0:1789448348.554853:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448348.554857:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.554861:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465f9dca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448348.555590:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.555853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295299968 00000100:00100000:0.0:1789448348.555866:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295299968 00000100:00100000:0.0:1789448348.555944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:0.0:1789448348.555957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:9999:x1876372295299968:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448348.555988:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448348.556009:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eda3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.556067:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eda3 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.556078:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eda3 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.556115:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:0.0:1789448348.556117:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448348.556119:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448348.556323:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+27:9999:x1876372295299968:12345-192.168.202.54@tcp:101:bash.0 Request processed in 369us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448348.556328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1789448348.558461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.558515:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300096 00000100:00100000:1.0:1789448348.558525:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300096 00000100:00100000:1.0:1789448348.558579:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789448348.558590:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:9999:x1876372295300096:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448348.558611:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448348.558635:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edaa expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448348.558665:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8d09a, atime: 0x6aa8d099, ctime: 0x6aa8d09a, blocks: 0xb 00010000:00010000:1.0:1789448348.558703:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1789448348.558770:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448348.558778:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.558795:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.558822:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9cae58600, rc 0) 00000100:00100000:1.0:1789448348.558875:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:9999:x1876372295300096:12345-192.168.202.54@tcp:101:bash.0 Request processed in 287us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448348.558883:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1789448348.560587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448348.560666:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300224 00000100:00100000:3.0:1789448348.560686:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300224 00002000:00010000:3.0:1789448348.560732:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789448348.560738:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9f4dbb480 with x1876372295300224 ext(0->18446744073709551615) 00002000:00010000:3.0:1789448348.560750:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9f4dbb480. 00000100:00100000:3.0:1789448348.560782:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789448348.560792:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295300224:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:3.0:1789448348.561161:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789448348.561164:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789448346 -> 1789448348 00002000:00010000:3.0:1789448348.561166:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789448345 -> 1789448345 00002000:00010000:3.0:1789448348.561167:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789448346 -> 1789448348 00002000:00010000:3.0:1789448348.561169:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789448348.561267:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2348:x1876372295300224:12345-192.168.202.54@tcp:10:bash.0 Request processed in 475us (686us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789448348.561274:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00010000:3.0:1789448348.561278:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789448348.561281:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9f4dbb480 with x1876372295300224 ext(0->18446744073709551615) 00002000:00010000:3.0:1789448348.561286:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9f4dbb480. 00000100:00100000:3.0:1789448348.665471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.666870:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300352 00000100:00100000:0.0:1789448348.666892:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300352 00000100:00100000:0.0:1789448348.666998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:0.0:1789448348.667012:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:10484:x1876372295300352:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1789448348.667116:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667139:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667155:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667195:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667203:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667565:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667584:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667593:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448348.667646:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667660:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667668:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667688:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667696:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.667700:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667710:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667724:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448348.667728:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448348.667733:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667741:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667764:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667771:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667777:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667783:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.667786:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667793:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667802:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0030900) 00010000:00010000:0.0:1789448348.667805:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448348.667808:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667814:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9de6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667832:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667838:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667844:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667857:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.667861:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667868:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667877:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:0.0:1789448348.667879:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448348.667882:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.667889:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448348.667995:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:10484:x1876372295300352:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 983us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448348.668004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1789448348.730654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.730847:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300608 00000100:00100000:1.0:1789448348.730859:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300608 00000100:00100000:1.0:1789448348.730938:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:1.0:1789448348.730950:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+27:10487:x1876372295300608:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448348.730998:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448348.731026:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9df4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731118:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731132:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731143:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731182:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731190:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731196:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731528:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465f9e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731538:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465f9e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731545:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465f9e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448348.731556:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789448348.731669:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731692:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731700:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731707:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448348.731713:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731721:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731731:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448348.731734:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448348.731739:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731751:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59e00/0xe29566c2465f9dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731763:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731767:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731771:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731774:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448348.731775:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731778:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731782:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9e0bd6600) 00010000:00010000:1.0:1789448348.731784:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448348.731785:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731788:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731826:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59a00/0xe29566c2465f9df4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb1 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731836:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465f9e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb1 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.731845:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:1.0:1789448348.731847:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789448348.731849:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34400, rc 0) 00000100:00100000:1.0:1789448348.731924:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10487:x1876372295300608:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 975us (1282us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789448348.731932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:1.0:1789448348.735660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.735804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300736 00000100:00100000:0.0:1789448348.735815:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300736 00000100:00100000:0.0:1789448348.735868:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1789448348.735877:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10487:x1876372295300736:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789448348.735944:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.735970:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.735981:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.736023:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.736036:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 29 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448348.736051:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317344128:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448348.736139:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448348.738968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448348.739069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295300992 00000100:00100000:2.0:1789448348.739087:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295300992 00000100:00100000:2.0:1789448348.739271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789448348.739286:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+30:5588:x1876372295300992:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789448348.739700:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+31:5588:x1876372295300992:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 415us (747us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789448348.739709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1789448348.740297:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317344128:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448348.740325:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.745761:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.745872:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295301120 00000100:00100000:1.0:1789448348.745885:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295301120 00010000:00010000:1.0:1789448348.745952:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 31 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448348.746178:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1789448348.746191:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+31:2351:x1876372295301120:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448348.746212:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448348.746312:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 31 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746367:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 31 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746444:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae58a00/0xe29566c2465f9dbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed9c expref: 31 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746462:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:1.0:1789448348.746481:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746490:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746497:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.746530:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448348.746589:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+30:2351:x1876372295301120:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 402us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448348.746595:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00010000:00010000:0.0:1789448348.746805:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746822:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746862:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746870:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746877:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746882:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.746887:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746909:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746929:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:0.0:1789448348.746932:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448348.746937:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.746944:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448348.747109:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10487:x1876372295300736:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 11228us (11453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448348.747120:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:2.0:1789448348.749941:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.750961:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295301376 00000100:00100000:1.0:1789448348.750977:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295301376 00000100:00100000:1.0:1789448348.751054:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448348.751063:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:10487:x1876372295301376:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448348.751417:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10487:x1876372295301376:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 355us (1485us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789448348.751424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00010000:00010000:3.0:1789448348.826246:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448348.859193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.859367:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295301632 00000100:00100000:1.0:1789448348.859377:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295301632 00000100:00100000:1.0:1789448348.859429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:1.0:1789448348.859439:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+30:10498:x1876372295301632:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789448348.859465:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448348.859486:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859565:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859597:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859607:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859612:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859619:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859892:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465f9e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859902:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465f9e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.859909:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465f9e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448348.859919:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789448348.860208:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860246:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860254:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448348.860272:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860281:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860293:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448348.860296:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448348.860301:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860308:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465f9e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860321:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860328:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860335:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860340:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448348.860343:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860348:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860365:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9e0bd6600) 00010000:00010000:1.0:1789448348.860368:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448348.860371:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860377:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465f9e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860420:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465f9e1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb8 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860434:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465f9e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb8 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.860442:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:1.0:1789448348.860445:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448348.860447:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35800, rc 0) 00000100:00100000:1.0:1789448348.860575:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+32:10498:x1876372295301632:12345-192.168.202.54@tcp:101:cat.0 Request processed in 1136us (1389us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789448348.860584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1789448348.867194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448348.867310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295301888 00000100:00100000:2.0:1789448348.867320:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295301888 00000100:00100000:2.0:1789448348.867421:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:2.0:1789448348.867431:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+32:10498:x1876372295301888:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:2.0:1789448348.867695:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10498:x1876372295301888:12345-192.168.202.54@tcp:35:cat.0 Request processed in 264us (509us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789448348.867703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:2.0:1789448348.887082:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.887246:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295302144 00000100:00100000:0.0:1789448348.887258:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295302144 00000100:00100000:0.0:1789448348.887320:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:0.0:1789448348.887330:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10499:x1876372295302144:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:0.0:1789448348.887389:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789448348.887417:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465f9e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb8 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887438:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465f9e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edb1 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887450:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eda3 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887480:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0a5c800) 00010000:00010000:0.0:1789448348.887491:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448348.887512:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887525:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887534:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887548:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887564:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.887571:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888074:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888084:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888092:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448348.888879:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789448348.888887:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370591669657ns, next at 371591667633ns, rc = 0 00010000:00010000:0.0:1789448348.888945:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888955:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888963:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888971:0:7825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888978:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.888985:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889007:0:7825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448348.889025:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889031:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889038:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889043:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.889047:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889053:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889070:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:0.0:1789448348.889073:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789448348.889077:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889083:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889098:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889104:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889109:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889114:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.889117:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889123:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889137:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448348.889140:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448348.889143:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.889148:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448348.889166:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a124cb1d reply state 00000000c0b3850c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448348.889174:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448348.889288:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+32:10499:x1876372295302144:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1956us (2214us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789448348.889296:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00010000:00010000:2.0:1789448348.890166:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448348.890174:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.890182:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448348.890186:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.890193:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.890204:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:2.0:1789448348.890207:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789448348.890210:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.890235:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9e56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.890253:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448348.890263:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448348.890264:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448348.903925:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.903944:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.903952:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.903959:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.903964:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.903992:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.904009:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0030900) 00010000:00010000:3.0:1789448348.904011:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448348.904017:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.904024:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.949875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.950252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295302400 00000100:00100000:0.0:1789448348.950263:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295302400 00000100:00100000:0.0:1789448348.950313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1789448348.950323:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+31:10505:x1876372295302400:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448348.950346:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448348.950366:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edbf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.950477:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.950493:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.950505:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.950520:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.950527:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.953965:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789448348.958460:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789448348.958648:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958666:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958693:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958949:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958957:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958965:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958971:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448348.958975:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958984:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.958996:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448348.958999:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448348.959014:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.959020:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9e64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448348.959038:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7ec3c59 reply state 00000000cce9a115 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448348.959047:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789448348.959082:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9e5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.959096:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448348.959104:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:0.0:1789448348.959107:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448348.959110:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33800, rc 0) 00000100:00100000:0.0:1789448348.959288:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+34:10505:x1876372295302400:12345-192.168.202.54@tcp:101:bash.0 Request processed in 8965us (9419us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789448348.959298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00010000:00010000:3.0:1789448348.964377:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964395:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964403:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964409:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448348.964414:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964422:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964439:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0030a00) 00010000:00010000:3.0:1789448348.964442:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448348.964447:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448348.964467:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9e6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.968771:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.969048:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295302528 00000100:00100000:1.0:1789448348.969057:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295302528 00000100:00100000:1.0:1789448348.969125:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:1.0:1789448348.969142:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295302528:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448348.969159:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448348.969178:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edc6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448348.969249:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789448348.969268:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1789448348.969272:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448348.969281:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.969298:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.969311:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35400, rc 0) 00000100:00100000:1.0:1789448348.969361:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295302528:12345-192.168.202.54@tcp:101:bash.0 Request processed in 222us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448348.969368:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00080000:2.0:1789448348.969884:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448348.973496:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448348.973595:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295302656 00000100:00100000:2.0:1789448348.973604:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295302656 00000100:00100000:2.0:1789448348.973660:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1789448348.973679:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:10505:x1876372295302656:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448348.973697:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448348.973723:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edcd expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.973754:0:10266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.973762:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448348.973767:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448348.973774:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.973809:0:10266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.973823:0:10266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 7 pid: 6671 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.974046:0:10266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10266:1876372317344256:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448348.974210:0:10266:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f53683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448348.977504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448348.977610:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295302784 00000100:00100000:1.0:1789448348.977628:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295302784 00010000:00010000:1.0:1789448348.977668:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 8 pid: 6671 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448348.977724:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789448348.977735:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295302784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448348.977748:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448348.977774:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 8 pid: 6671 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.977806:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 8 pid: 6671 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.977829:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448348.977834:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448348.977841:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 8 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.977850:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 8 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448348.977886:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 8 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448348.977899:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876372317344384:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448348.977977:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789448348.978576:0:10266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099370f6f/0xe29566c2465f9e80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edc6 expref: 8 pid: 6671 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448348.978591:0:10266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4db9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10266:1876372317344256:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448348.978613:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448348.978623:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2600, rc 0) 00000100:00100000:2.0:1789448348.978665:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:10505:x1876372295302656:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4997us (5177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448348.978682:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:1.0:1789448348.982527:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876372317344384:192.168.202.54@tcp:105: 00010000:00010000:1.0:1789448348.982562:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448348.982629:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295302784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4894us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448348.982640:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789448348.987169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448348.987273:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303040 00000100:00100000:0.0:1789448348.987282:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303040 00000100:00100000:0.0:1789448348.987339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1789448348.987350:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+33:10505:x1876372295303040:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:0.0:1789448348.987871:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+34:10505:x1876372295303040:12345-192.168.202.54@tcp:35:bash.0 Request processed in 522us (711us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789448348.987880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000040:00080000:1.0:1789448349.017441:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448349.017451:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448349.017500:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789448349.017506:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789448349.163388:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.163521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303168 00000100:00100000:3.0:1789448349.163531:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303168 00000100:00100000:3.0:1789448349.163599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:3.0:1789448349.163609:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+34:10521:x1876372295303168:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448349.163642:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448349.163663:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edd4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163741:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163756:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163767:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448349.163800:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789448349.163804:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448349.163820:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163846:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edd4 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163883:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edd4 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.163892:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448349.163894:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448349.163898:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27600, rc 0) 00000100:00100000:3.0:1789448349.163960:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:10521:x1876372295303168:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 353us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.163967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1789448349.176137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.176250:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303424 00000100:00100000:1.0:1789448349.176260:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303424 00000100:00100000:1.0:1789448349.176327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789448349.176338:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+35:10521:x1876372295303424:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448349.176360:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448349.176383:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465f9e9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eddb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.176484:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465f9ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.176496:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465f9ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.176505:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465f9ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448349.176514:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789448349.176619:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465f9e9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eddb expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.176636:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465f9ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eddb expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.176644:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:1.0:1789448349.176647:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448349.176651:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448349.176829:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+37:10521:x1876372295303424:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 490us (700us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789448349.176849:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789448349.186745:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.186917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303680 00000100:00100000:3.0:1789448349.186927:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303680 00000100:00100000:3.0:1789448349.186981:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1789448349.186991:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+37:10521:x1876372295303680:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448349.187014:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448349.187036:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9eb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ede2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.187122:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.187135:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.187147:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448349.187169:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789448349.187319:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9eb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede2 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.187336:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede2 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.187344:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:3.0:1789448349.187348:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789448349.187351:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448349.187413:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+39:10521:x1876372295303680:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 422us (678us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789448349.187419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1789448349.193610:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.193661:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.193823:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303936 00000100:00100000:1.0:1789448349.193833:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303936 00000100:00100000:1.0:1789448349.193959:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:1.0:1789448349.193971:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295303936:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:1.0:1789448349.194020:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.194040:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.194049:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448349.194055:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448349.194060:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.194094:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.194108:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 6 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448349.194122:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1876372317344512:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448349.194257:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448349.194384:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295303808 00000100:00100000:3.0:1789448349.194389:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295303808 00000100:00100000:3.0:1789448349.194435:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789448349.194443:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+39:2350:x1876372295303808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448349.194454:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448349.194480:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465f9ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eddb expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.194495:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:3.0:1789448349.194500:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448349.194526:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+38:2350:x1876372295303808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 85us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.194534:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448349.201119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.201266:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1876372317344512:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448349.201292:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.202097:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304064 00000100:00100000:3.0:1789448349.202107:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304064 00002000:00100000:3.0:1789448349.202288:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97d9ead40a80 x1876372295304064/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:210/0 lens 504/0 e 0 to 0 dl 1789448360 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448349.202299:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead40a80 with x1876372295304064 ext(0->8) 00010000:00010000:3.0:1789448349.202307:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 7 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.202323:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 7 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448349.202331:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead40a80 00000100:00100000:3.0:1789448349.202410:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789448349.202421:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295304064:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:3.0:1789448349.202891:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295304064:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 470us (1779us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789448349.202900:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00100000:3.0:1789448349.202907:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97d9ead40a80 x1876372295304064/t4294967302(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:210/0 lens 504/448 e 0 to 0 dl 1789448360 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448349.202916:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead40a80 with x1876372295304064 ext(0->8) 00010000:00010000:3.0:1789448349.202922:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.202935:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448349.202942:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead40a80 00000100:00100000:2.0:1789448349.215939:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.216040:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304192 00000100:00100000:3.0:1789448349.216049:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304192 00010000:00010000:3.0:1789448349.216081:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.216117:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:3.0:1789448349.216123:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295304192:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448349.216136:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789448349.216167:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789448349.216171:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789448349 00002000:00010000:3.0:1789448349.216173:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789448349 00002000:00010000:3.0:1789448349.216175:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789448349 00010000:00010000:3.0:1789448349.216181:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.216197:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.216235:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465f9e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edcd expref: 9 pid: 10266 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.216249:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448349.216252:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448349.216256:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.216263:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.216297:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448349.216337:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295304192:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 214us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.216342:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00010000:00010000:2.0:1789448349.216495:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216502:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216523:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216537:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216542:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216546:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448349.216549:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216555:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216563:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.216568:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a2d953/0xe29566c2465f9ec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448349.216602:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295303936:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 22636us (23001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448349.216607:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1789448349.219745:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.220549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304448 00000100:00100000:1.0:1789448349.220560:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304448 00000100:00100000:1.0:1789448349.220638:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1789448349.220649:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:10521:x1876372295304448:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:1.0:1789448349.220722:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede2 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448349.220970:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789448349.221016:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789448349.221333:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789448349.221382:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.221397:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.221406:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.221439:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.221454:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 42 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448349.221488:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5509500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317344640:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448349.221571:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb089900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448349.227139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.227272:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5509500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317344640:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448349.227293:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.227379:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304576 00000100:00100000:3.0:1789448349.227387:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304576 00010000:00010000:3.0:1789448349.227424:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 43 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.227458:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1789448349.227465:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+43:2350:x1876372295304576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448349.227488:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448349.227494:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 43 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227502:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 43 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227519:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edbf expref: 43 pid: 5835 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227531:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:3.0:1789448349.227534:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227541:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227557:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.227580:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448349.227692:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.227710:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448349.227838:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789448349.228030:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789448349.228038:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+44:2350:x1876372295304576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 572us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.228047:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1789448349.228138:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead43800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317344768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789448349.228197:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448349.228266:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448349.228424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317344768 00000100:00100000:3.0:1789448349.228430:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317344768 00000100:00100000:3.0:1789448349.228477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448349.228494:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1876372317344768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789448349.228563:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1876372317344768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.228570:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789448349.228785:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448349.228815:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead43800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317344768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789448349.229318:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789448349.229387:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead43800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317344896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789448349.229423:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448349.229444:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f53683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448349.229668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317344896 00000100:00100000:3.0:1789448349.229683:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317344896 00000100:00100000:3.0:1789448349.229711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448349.229719:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1876372317344896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789448349.229863:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5836:x1876372317344896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (437us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789448349.229871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448349.229988:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead43800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317344896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789448349.230033:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789448349.230069:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230079:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230087:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230094:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448349.230099:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230115:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230132:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:2.0:1789448349.230135:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789448349.230140:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.230342:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465f9ecd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789448349.230704:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789448349.230835:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789448349.230847:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370933628729ns, next at 371933626329ns, rc = 0 00000001:00080000:2.0:1789448349.230853:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789448349.230883:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030b00) 00010000:00010000:2.0:1789448349.230886:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789448349.230893:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465f9eb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede2 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448349.230983:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+45:10521:x1876372295304448:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 10335us (11246us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789448349.230992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000020:00080000:2.0:1789448349.230996:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789448349.234887:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.234976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304704 00000100:00100000:0.0:1789448349.234987:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304704 00000100:00100000:0.0:1789448349.235096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:0.0:1789448349.235107:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+45:10521:x1876372295304704:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448349.235143:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448349.235177:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9ed4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ede9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.235271:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede9 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.235288:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede9 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.235305:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.235308:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448349.235311:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448349.235364:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+46:10521:x1876372295304704:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 259us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.235372:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:0.0:1789448349.242169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.242276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295304960 00000100:00100000:1.0:1789448349.242286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295304960 00000100:00100000:1.0:1789448349.242341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789448349.242352:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+46:10521:x1876372295304960:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448349.242643:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10521:x1876372295304960:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 293us (484us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789448349.242652:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1789448349.346056:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.346776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295305088 00000100:00100000:3.0:1789448349.346786:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295305088 00000100:00100000:3.0:1789448349.346842:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789448349.346852:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10531:x1876372295305088:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1789448349.346930:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.346962:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.346977:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.346992:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.346998:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347005:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347092:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347098:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347103:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789448349.347139:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347152:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347158:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347175:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347181:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448349.347186:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347194:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347206:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448349.347209:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448349.347214:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347259:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347265:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347271:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347276:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448349.347279:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347294:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347301:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0a5c600) 00010000:00010000:3.0:1789448349.347302:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448349.347304:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347308:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9ee2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347318:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347321:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347325:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347328:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448349.347330:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347333:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448349.347338:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448349.347339:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.347349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.347409:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10531:x1876372295305088:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 558us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.347417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789448349.398912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.399206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295305344 00000100:00100000:1.0:1789448349.399253:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295305344 00000100:00100000:1.0:1789448349.399316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:1.0:1789448349.399326:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+47:10534:x1876372295305344:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448349.399346:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448349.399365:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9ef0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edf0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399435:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399449:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399474:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399490:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399496:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.399502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400349:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400362:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400371:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448349.400382:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789448349.400486:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400494:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400501:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400507:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448349.400520:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400528:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400539:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448349.400542:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448349.400547:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400553:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9ef7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400566:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400571:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400577:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400582:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448349.400585:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400590:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400596:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9e0bd6300) 00010000:00010000:1.0:1789448349.400598:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448349.400605:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400676:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9efe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400772:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9ef0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf0 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400786:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf0 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.400793:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:1.0:1789448349.400795:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448349.400797:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34e00, rc 0) 00000100:00100000:1.0:1789448349.400898:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10534:x1876372295305344:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1573us (1995us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789448349.400906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:0.0:1789448349.409773:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.409874:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295305472 00000100:00100000:2.0:1789448349.409885:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295305472 00000100:00100000:2.0:1789448349.409968:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1789448349.409979:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10534:x1876372295305472:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789448349.410053:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410068:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410080:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410107:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410115:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410122:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410139:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448349.410150:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410159:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410170:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:2.0:1789448349.410174:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448349.410179:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.410196:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465f9f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448349.410323:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10534:x1876372295305472:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 345us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448349.410332:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1789448349.413766:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.413858:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295305728 00000100:00100000:1.0:1789448349.413869:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295305728 00000100:00100000:1.0:1789448349.413921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789448349.413931:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+49:10534:x1876372295305728:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448349.414177:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+50:10534:x1876372295305728:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 245us (419us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789448349.414185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789448349.516438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.516541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295305984 00000100:00100000:0.0:1789448349.516552:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295305984 00000100:00100000:0.0:1789448349.516624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1789448349.516636:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+50:10544:x1876372295305984:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448349.516683:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448349.516686:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789448349.516724:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465f9e95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edd4 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.516745:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448349.516750:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448349.516763:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edf7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.516861:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9f21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.516875:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.516885:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448349.516896:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789448349.517017:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf7 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.517033:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf7 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.517039:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.517042:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448349.517044:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33800, rc 0) 00000100:00100000:0.0:1789448349.517402:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10544:x1876372295305984:12345-192.168.202.54@tcp:101:bash.0 Request processed in 768us (972us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789448349.517409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1789448349.523564:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.523662:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295306240 00000100:00100000:2.0:1789448349.523681:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295306240 00000100:00100000:2.0:1789448349.523747:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:2.0:1789448349.523757:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10544:x1876372295306240:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1789448349.523811:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789448349.523836:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465f9f21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf7 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.523856:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edf0 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.523867:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:2.0:1789448349.523871:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448349.524061:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.524074:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448349.524084:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448349.524325:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789448349.524352:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c14b153 reply state 00000000d3880fc1 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448349.524361:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448349.524440:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10544:x1876372295306240:12345-192.168.202.54@tcp:36:bash.0 Request processed in 683us (884us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789448349.524448:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000020:00080000:2.0:1789448349.524452:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789448349.527045:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527062:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527070:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527077:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448349.527082:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527090:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527106:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448349.527109:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448349.527114:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.527121:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465f9f2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448349.529784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.529875:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295306368 00000100:00100000:1.0:1789448349.529885:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295306368 00000100:00100000:1.0:1789448349.529955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:1.0:1789448349.529965:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+51:10544:x1876372295306368:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448349.529989:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448349.530010:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9f36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533edfe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530090:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530105:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530117:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448349.530159:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789448349.530164:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448349.530184:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9f36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530257:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.530266:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:1.0:1789448349.530269:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448349.530272:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35600, rc 0) 00000100:00100000:1.0:1789448349.530333:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10544:x1876372295306368:12345-192.168.202.54@tcp:101:bash.0 Request processed in 369us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448349.530346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1789448349.535076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.535164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295306624 00000100:00100000:1.0:1789448349.535176:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295306624 00000100:00100000:1.0:1789448349.535248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789448349.535257:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+52:10544:x1876372295306624:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:1.0:1789448349.535471:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10544:x1876372295306624:12345-192.168.202.54@tcp:35:bash.0 Request processed in 214us (404us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789448349.535478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1789448349.608626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.608908:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295306752 00000100:00100000:0.0:1789448349.608918:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295306752 00000100:00100000:0.0:1789448349.608973:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789448349.608982:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+53:10550:x1876372295306752:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448349.609006:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448349.609025:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee05 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609085:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609098:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609110:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448349.609141:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789448349.609144:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448349.609161:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609182:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee05 expref: 55 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609398:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee05 expref: 54 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.609408:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448349.609410:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448349.609414:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448349.609488:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295306752:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 507us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.609495:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789448349.613146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448349.613287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295306880 00000100:00100000:1.0:1789448349.613298:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295306880 00000100:00100000:1.0:1789448349.613353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:1.0:1789448349.613362:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295306880:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448349.613382:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448349.613403:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9f52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee0c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613466:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613481:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613493:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613531:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613538:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613645:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613654:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613662:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448349.613716:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789448349.613721:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448349.613740:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613752:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613761:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613768:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613775:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613792:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448349.613797:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613805:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613818:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:1.0:1789448349.613821:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448349.613826:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613833:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465f9f59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613848:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613854:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613860:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613865:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448349.613868:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613874:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613891:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9e0bd6300) 00010000:00010000:1.0:1789448349.613894:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448349.613897:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613903:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465f9f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613933:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465f9f52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613946:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448349.613954:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:1.0:1789448349.613956:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448349.613959:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34000, rc 0) 00000100:00100000:1.0:1789448349.614012:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10550:x1876372295306880:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 651us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448349.614020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:2.0:1789448349.618768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.618889:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307136 00000100:00100000:3.0:1789448349.618900:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307136 00000100:00100000:3.0:1789448349.618957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:3.0:1789448349.618966:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10550:x1876372295307136:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448349.618988:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448349.619009:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee13 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619106:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619120:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619140:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619148:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619184:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619198:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.619210:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317345024:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448349.619352:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.619362:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.619371:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01eb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317345152:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448349.619394:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448349.623883:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.623990:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307264 00000100:00100000:0.0:1789448349.624000:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307264 00010000:00010000:0.0:1789448349.624039:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 57 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448349.624082:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:0.0:1789448349.624091:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+57:2351:x1876372295307264:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448349.624107:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448349.624113:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 57 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.624137:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 57 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.624161:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.624180:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.624190:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.624197:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448349.624281:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+57:2351:x1876372295307264:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 190us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.624289:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00010000:00010000:3.0:1789448349.625045:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465f9f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee0c expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.625064:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317345024:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448349.625075:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01eb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317345152:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448349.625100:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448349.627578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448349.627663:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307392 00000100:00100000:3.0:1789448349.627682:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307392 00010000:00010000:3.0:1789448349.627729:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448349.627773:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:3.0:1789448349.627783:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+56:2349:x1876372295307392:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448349.627797:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448349.627803:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627834:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627857:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465f9f3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edfe expref: 56 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627874:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448349.627879:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627889:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627898:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448349.627931:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448349.627983:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+55:2349:x1876372295307392:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 201us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.627990:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00010000:00010000:0.0:1789448349.628507:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.628518:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448349.628538:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789448349.628722:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465f9f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.628739:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.628747:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.628750:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789448349.628752:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27000, rc 0) 00000100:00100000:0.0:1789448349.628797:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10550:x1876372295307136:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 9831us (10037us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789448349.628804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:2.0:1789448349.631798:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.631836:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.631862:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448349.631975:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.632085:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307520 00000100:00100000:0.0:1789448349.632109:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307520 00000100:00100000:0.0:1789448349.632171:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 290 00000100:00100000:0.0:1789448349.632182:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295307520:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448349.632262:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295307520:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 80us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.632270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 290 00000100:00100000:0.0:1789448349.632315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307904 00000100:00100000:0.0:1789448349.632319:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307904 00000100:00100000:0.0:1789448349.632355:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:0.0:1789448349.632361:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295307904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448349.632390:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295307904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.632396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00080000:2.0:1789448349.632461:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448349.633979:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307776 00000100:00100000:3.0:1789448349.633992:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307776 00000100:00100000:3.0:1789448349.634042:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295307648 00000100:00100000:3.0:1789448349.634045:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295307648 00000100:00100000:3.0:1789448349.634071:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:3.0:1789448349.634079:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295307776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448349.634148:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295307776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 69us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.634167:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:3.0:1789448349.634181:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1789448349.634187:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295307648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448349.634211:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295307648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448349.634238:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00080000:2.0:1789448349.634800:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448349.645198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.645313:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308160 00000100:00100000:0.0:1789448349.645324:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308160 00000100:00100000:0.0:1789448349.645380:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789448349.645390:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10550:x1876372295308160:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:0.0:1789448349.645407:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448349.645434:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9ed4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ede9 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.645452:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.645457:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448349.645515:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295308160:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.645523:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789448349.648806:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.648881:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308288 00000100:00100000:0.0:1789448349.648890:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308288 00000100:00100000:0.0:1789448349.648945:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1789448349.648955:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295308288:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:0.0:1789448349.649065:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.649082:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.649093:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448349.649327:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789448349.649408:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295308288:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 453us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.649416:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:2.0:1789448349.654612:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448349.654997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308416 00000100:00100000:0.0:1789448349.655008:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308416 00000100:00100000:0.0:1789448349.655068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1789448349.655078:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:10550:x1876372295308416:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448349.655099:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448349.655120:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee1a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655189:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655202:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655266:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655281:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655295:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448349.655298:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448349.655302:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448349.655309:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33a00, rc 0) 00000100:00100000:0.0:1789448349.655368:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10550:x1876372295308416:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 291us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448349.655375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00010000:00010000:3.0:1789448349.849560:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448350.041859:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448350.041871:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448350.041932:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789448350.041939:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789448350.042080:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317345280:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789448350.042196:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448350.058415:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317345280:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789448350.066119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.071746:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308544 00000100:00100000:0.0:1789448350.071763:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308544 00000100:00100000:0.0:1789448350.071905:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:0.0:1789448350.071916:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10551:x1876372295308544:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789448350.072092:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789448350.072336:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10551:x1876372295308544:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 422us (6226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.072345:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:3.0:1789448350.075553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.076305:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308672 00000100:00100000:0.0:1789448350.076316:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308672 00000100:00100000:0.0:1789448350.076365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:0.0:1789448350.076391:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10551:x1876372295308672:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.076462:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076492:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076545:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076553:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076560:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076585:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076595:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.076602:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448350.076647:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789448350.076652:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448350.076675:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078316:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078326:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078333:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078340:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.078344:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078352:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078367:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:0.0:1789448350.078370:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448350.078375:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078382:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465f9f91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078399:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078405:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078412:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078428:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.078431:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078438:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078446:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97d9d0030d00) 00010000:00010000:0.0:1789448350.078449:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448350.078451:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078457:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9f98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078473:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078480:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078486:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078491:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.078494:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078500:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078519:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448350.078522:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448350.078525:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.078531:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.078614:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10551:x1876372295308672:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 2222us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.078623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00080000:2.0:1789448350.081136:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448350.089346:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.089537:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295308928 00000100:00100000:0.0:1789448350.089547:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295308928 00000100:00100000:0.0:1789448350.089607:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:0.0:1789448350.089617:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:10551:x1876372295308928:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.089638:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.089660:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089777:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089792:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089805:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448350.089817:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789448350.089930:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089939:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089946:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089953:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.089957:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089965:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089977:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448350.089981:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789448350.089986:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.089992:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.090034:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fa6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee21 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.090045:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:0.0:1789448350.090047:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448350.090051:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee21 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.090071:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32000, rc 0) 00000100:00100000:0.0:1789448350.090132:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295308928:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 515us (794us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789448350.090139:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:2.0:1789448350.103349:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.103561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295309056 00000100:00100000:3.0:1789448350.103571:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295309056 00000100:00100000:3.0:1789448350.103616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789448350.103634:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295309056:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789448350.103680:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789448350.103994:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295309056:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 370us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448350.104002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789448350.115570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.115716:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295309312 00000100:00100000:0.0:1789448350.115727:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295309312 00000100:00100000:0.0:1789448350.115786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:0.0:1789448350.115797:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295309312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.115817:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.115820:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789448350.115845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee05 expref: 56 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.115865:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448350.115870:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448350.115883:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee28 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789448350.116677:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789448350.116880:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.116896:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.116912:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.117445:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee28 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.117464:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee28 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.117472:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030d00) 00010000:00010000:0.0:1789448350.117475:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448350.117478:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448350.117540:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10551:x1876372295309312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1745us (1979us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789448350.117548:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:2.0:1789448350.124342:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.124457:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295309568 00000100:00100000:3.0:1789448350.124466:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295309568 00000100:00100000:3.0:1789448350.124523:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1789448350.124533:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10551:x1876372295309568:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448350.124588:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448350.124615:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465f9fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee28 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124654:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030d00) 00010000:00010000:3.0:1789448350.124678:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448350.124707:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124720:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124731:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124746:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124753:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124759:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124822:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124830:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124837:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124844:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.124849:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124863:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124871:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448350.124874:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448350.124878:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124884:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9fd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124893:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124899:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124905:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124911:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.124913:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124919:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124926:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5420a3e4 (ffff97d9d0a5c600) 00010000:00010000:3.0:1789448350.124928:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448350.124930:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.124945:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5420a3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.125028:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295309568:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 496us (695us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448350.125035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1789448350.133134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.133266:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295309696 00000100:00100000:0.0:1789448350.133276:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295309696 00000100:00100000:0.0:1789448350.133337:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1789448350.133349:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+56:10551:x1876372295309696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.133370:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.133395:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee2f expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133430:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133443:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133455:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133554:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9fde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 58 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133573:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 57 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.133582:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:0.0:1789448350.133585:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789448350.133588:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448350.133646:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10551:x1876372295309696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 300us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.133654:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:2.0:1789448350.146862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.149444:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295309952 00000100:00100000:3.0:1789448350.149459:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295309952 00000100:00100000:3.0:1789448350.149536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1789448350.149548:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+57:10551:x1876372295309952:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448350.149645:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.149671:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.149684:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448350.149922:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789448350.149931:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371852713295ns, next at 372852711375ns, rc = 0 00000004:00010000:3.0:1789448350.150025:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004c1aeff reply state 00000000f05e4dda transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.150035:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789448350.150144:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+59:10551:x1876372295309952:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 597us (3291us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789448350.150152:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00010000:00010000:3.0:1789448350.151932:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.151958:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.151967:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.151973:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.151978:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.151986:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.152003:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:3.0:1789448350.152006:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789448350.152012:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.152018:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465f9fec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.156533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.156604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310080 00000100:00100000:3.0:1789448350.156615:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310080 00000100:00100000:3.0:1789448350.156680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:3.0:1789448350.156696:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+58:10551:x1876372295310080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448350.156720:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448350.156745:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.156830:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.156846:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.156867:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:3.0:1789448350.156870:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448350.156875:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26600, rc 0) 00000100:00100000:3.0:1789448350.156935:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+59:10551:x1876372295310080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 246us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448350.156942:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:2.0:1789448350.163130:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.163326:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310208 00000100:00100000:3.0:1789448350.163338:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310208 00000100:00100000:3.0:1789448350.163399:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1789448350.163409:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295310208:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789448350.163789:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295310208:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 380us (667us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789448350.163797:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789448350.167500:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.167603:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310464 00000100:00100000:1.0:1789448350.167613:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310464 00000100:00100000:1.0:1789448350.167679:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:1.0:1789448350.167696:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+59:10551:x1876372295310464:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789448350.167929:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+60:10551:x1876372295310464:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 241us (438us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789448350.167937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1789448350.178177:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.178578:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310720 00000100:00100000:1.0:1789448350.178589:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310720 00000100:00100000:1.0:1789448350.178671:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:1.0:1789448350.178682:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+60:10551:x1876372295310720:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789448350.178803:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+60:10551:x1876372295310720:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 122us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.178810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:3.0:1789448350.187081:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.187298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310848 00000100:00100000:0.0:1789448350.187308:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310848 00000100:00100000:0.0:1789448350.187370:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1789448350.187380:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+60:10551:x1876372295310848:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.187400:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.187421:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9ffa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee3d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187487:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187502:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187514:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448350.187560:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448350.187577:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187602:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465f9ffa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee3d expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187622:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee3d expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.187630:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:0.0:1789448350.187634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789448350.187637:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33200, rc 0) 00000100:00100000:0.0:1789448350.187710:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+61:10551:x1876372295310848:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 332us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.187717:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1789448350.194169:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.194318:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295310976 00000100:00100000:0.0:1789448350.194328:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295310976 00000100:00100000:0.0:1789448350.194386:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1789448350.194397:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295310976:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.194416:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.194438:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee44 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448350.194466:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d09e, blocks: 0x1 00010000:00010000:0.0:1789448350.194497:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789448350.194515:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448350.194524:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 10 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.194543:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 10 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.194556:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32000, rc 0) 00000100:00100000:0.0:1789448350.194614:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2351:x1876372295310976:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 219us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.194621:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789448350.202873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.202984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311232 00000100:00100000:1.0:1789448350.202994:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311232 00000100:00100000:1.0:1789448350.203053:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:1.0:1789448350.203064:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+61:10551:x1876372295311232:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789448350.203178:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+61:10551:x1876372295311232:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.203186:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:3.0:1789448350.209599:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448350.209868:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311360 00000100:00100000:2.0:1789448350.209878:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311360 00000100:00100000:2.0:1789448350.209932:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789448350.209942:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:10551:x1876372295311360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448350.209960:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448350.209981:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee4b expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.210011:0:10266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 11 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.210020:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448350.210025:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448350.210031:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 11 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.210062:0:10266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 11 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.210075:0:10266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 11 pid: 6671 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.210109:0:10266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10266:1876372317345408:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448350.210212:0:10266:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448350.217630:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.217742:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311488 00000100:00100000:1.0:1789448350.217752:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311488 00010000:00010000:1.0:1789448350.217793:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 12 pid: 6671 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.217857:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1789448350.217867:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+12:2351:x1876372295311488:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448350.217883:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448350.217908:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 12 pid: 6671 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.217923:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 12 pid: 6671 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.217959:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448350.217964:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448350.217973:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 12 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.217982:0:7613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 12 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.218017:0:7613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 12 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.218031:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317345536:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448350.218112:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999240 going to sleep for 11 seconds 00010000:00010000:3.0:1789448350.218532:0:10266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465fa008 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee44 expref: 12 pid: 6671 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.218562:0:10266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10266:1876372317345408:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448350.218587:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 11 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.218598:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3a00, rc 0) 00000100:00100000:3.0:1789448350.218643:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+11:10551:x1876372295311360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 8702us (9055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448350.218651:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1789448350.230742:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317345536:192.168.202.54@tcp:105: 00010000:00010000:1.0:1789448350.230781:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448350.230843:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2351:x1876372295311488:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 12976us (13231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.230855:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789448350.233678:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.233770:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311616 00000100:00100000:3.0:1789448350.233780:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311616 00002000:00100000:3.0:1789448350.233831:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97d9ead4df80 x1876372295311616/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:211/0 lens 504/0 e 0 to 0 dl 1789448361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448350.233844:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead4df80 with x1876372295311616 ext(0->12) 00002000:00010000:3.0:1789448350.233850:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9ead4df80 00000100:00100000:3.0:1789448350.233882:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789448350.233892:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2351:x1876372295311616:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789448350.234573:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+12:2351:x1876372295311616:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 680us (911us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789448350.234582:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:3.0:1789448350.234589:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97d9ead4df80 x1876372295311616/t4294967308(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:211/0 lens 504/448 e 0 to 0 dl 1789448361 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448350.234597:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead4df80 with x1876372295311616 ext(0->12) 00002000:00010000:3.0:1789448350.234608:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9ead4df80 00000100:00100000:0.0:1789448350.243178:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.243277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311744 00000100:00100000:3.0:1789448350.243287:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311744 00000100:00100000:3.0:1789448350.243347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1789448350.243357:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+61:10551:x1876372295311744:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789448350.324752:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:2.0:1789448350.324784:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789448350.324815:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9f4a5f3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789448350.324820:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9f494a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9f4a5f780 00000020:00080000:2.0:1789448350.324824:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9f494ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9fffa3000 00000001:00080000:2.0:1789448350.324850:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1789448350.324895:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789448350.324906:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9f5368c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789448350.324910:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9cadda900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9f5368f00 00000020:00080000:2.0:1789448350.324912:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9e0a3ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d8c121a800 00000004:00080000:2.0:1789448350.324930:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789448350.325069:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789448350.325323:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789448350.325420:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448350.325437:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317345664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789448350.325495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448350.325559:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317345664 00000100:00100000:3.0:1789448350.325566:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317345664 00000100:00100000:3.0:1789448350.325606:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448350.325614:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1876372317345664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789448350.325655:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789448350.325886:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8d09d, atime: 0x6aa8d09d, ctime: 0x6aa8d09d, blocks: 0x1 00010000:00010000:3.0:1789448350.325896:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.325912:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789448350.325916:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448350.325923:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.325939:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.325968:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.325978:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.325996:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789448350.326499:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3306:x1876372317345664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 884us (1003us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789448350.326508:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789448350.326538:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448350.326546:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.326555:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448350.326560:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.326572:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.326589:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.326598:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa016 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.326870:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317345792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789448350.326903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448350.326935:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448350.326941:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317345920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789448350.326962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448350.326987:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317345792 00000100:00100000:0.0:1789448350.326993:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317345792 00000100:00100000:0.0:1789448350.327025:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317345920 00000100:00100000:0.0:1789448350.327028:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317345920 00000100:00100000:0.0:1789448350.327043:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789448350.327049:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876372317345792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789448350.327065:0:6672:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789448350.327083:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.327111:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.327132:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789448350.327136:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789448350.327141:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.327167:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.327182:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 11 pid: 6673 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.327195:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317346048:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448350.327266:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789448350.327281:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789448350.327288:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876372317345920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789448350.327391:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789448350.327396:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789448350 00002000:00010000:0.0:1789448350.327399:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789448350.327401:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789448350 -> 1789448350 00002000:00010000:0.0:1789448350.327404:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789448350.327433:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1876372317345920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (470us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789448350.327445:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789448350.327479:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9ead4d880/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789448350.327485:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317345920:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789448350.327503:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789448350.332045:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.332048:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.332051:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789448350.332103:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9d138c700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789448350.332113:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317345664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789448350.332339:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.332966:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295311872 00000100:00100000:3.0:1789448350.332975:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295311872 00010000:00010000:3.0:1789448350.333010:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 12 pid: 6673 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.333048:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789448350.333058:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+12:2350:x1876372295311872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448350.333071:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448350.333078:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 12 pid: 6673 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.333091:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 12 pid: 6673 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.333245:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317346048:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448350.333363:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ecda7be/0xe29566c2465f9dd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533edaa expref: 12 pid: 6673 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.336567:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10551:x1876372295311744:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 93201us (93388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.336579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00010000:00010000:0.0:1789448350.340951:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.343898:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448350.343909:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448350.343933:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.343947:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.344000:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448350.344083:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2350:x1876372295311872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11020us (11742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448350.344093:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00010000:00010000:1.0:1789448350.344212:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.344255:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.344266:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.344274:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.344297:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789448350.344870:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1876372317345792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17819us (17964us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789448350.344879:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789448350.345176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00080000:0.0:1789448350.345498:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9ead4ed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789448350.345506:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317345792:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789448350.345784:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448350.345793:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.345805:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448350.345810:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.345821:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.345841:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.345850:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465fa01d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.345893:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.345895:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.345897:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448350.346791:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312000 00000100:00100000:1.0:1789448350.346803:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312000 00000100:00100000:1.0:1789448350.346861:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1789448350.346871:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2350:x1876372295312000:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789448350.441373:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2350:x1876372295312000:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 94492us (96187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.441387:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000001:00080000:1.0:1789448350.442108:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789448350.444830:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789448350.444843:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789448350.444849:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789448350.448958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.449069:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312256 00000100:00100000:1.0:1789448350.449080:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312256 00000100:00100000:1.0:1789448350.449151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1789448350.449162:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10551:x1876372295312256:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448350.449252:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448350.449283:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee3d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.449304:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:1.0:1789448350.449310:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448350.449341:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.449356:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.449366:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448350.449593:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a161d14 reply state 0000000017510b16 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.449602:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448350.449959:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:10551:x1876372295312256:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 798us (1009us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789448350.449981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:2.0:1789448350.465456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.467428:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312384 00000100:00100000:0.0:1789448350.467443:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312384 00000100:00100000:0.0:1789448350.467506:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789448350.467516:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295312384:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789448350.467785:0:10266:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789448350.467789:0:10266:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789448350 -> 1789448349 00002000:00010000:0.0:1789448350.467791:0:10266:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789448349 00002000:00010000:0.0:1789448350.467793:0:10266:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789448350 -> 1789448349 00002000:00010000:0.0:1789448350.467796:0:10266:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789448350.467873:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295312384:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 358us (2426us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789448350.467895:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00010000:00010000:3.0:1789448350.473846:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473865:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473873:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473880:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.473884:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473892:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473909:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:3.0:1789448350.473912:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448350.473917:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.473923:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.477390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.477590:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312640 00000100:00100000:1.0:1789448350.477600:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312640 00000100:00100000:1.0:1789448350.477676:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1789448350.477695:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+15:10551:x1876372295312640:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789448350.477769:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.477787:0:7825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.477796:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.477830:0:7825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.477843:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 15 pid: 7825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.477855:0:7825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317346176:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448350.477936:0:7825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448350.481353:0:7825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317346176:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448350.481388:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.482134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448350.482255:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312768 00000100:00100000:2.0:1789448350.482267:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312768 00010000:00010000:2.0:1789448350.482305:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 16 pid: 7825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.482343:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1789448350.482366:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:2350:x1876372295312768:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448350.482381:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448350.482388:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 16 pid: 7825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482399:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 16 pid: 7825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482419:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465f9fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee2f expref: 16 pid: 7825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482434:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:2.0:1789448350.482439:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482447:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482455:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.482487:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448350.482535:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+15:2350:x1876372295312768:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 171us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448350.482542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00010000:00010000:3.0:1789448350.482621:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482630:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482674:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482682:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482692:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482698:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.482703:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482711:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482720:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:3.0:1789448350.482722:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789448350.482727:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.482733:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa02b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.482772:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10551:x1876372295312640:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 5087us (5391us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789448350.482780:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:2.0:1789448350.489074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.489523:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295312896 00000100:00100000:0.0:1789448350.489532:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295312896 00000100:00100000:0.0:1789448350.489578:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:0.0:1789448350.489587:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2349:x1876372295312896:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789448350.489640:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.489671:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.489680:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789448350.489691:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789448350.489696:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.489730:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.489743:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 7 pid: 10266 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.489758:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317346304:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448350.489859:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448350.505893:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317346304:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448350.505922:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.506076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.506411:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295313024 00000100:00100000:1.0:1789448350.506428:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295313024 00010000:00010000:1.0:1789448350.506465:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 8 pid: 10266 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.506500:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1789448350.506509:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295313024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448350.506522:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448350.506548:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 8 pid: 10266 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.506560:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 8 pid: 10266 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.506581:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa00f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee4b expref: 8 pid: 10266 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.506598:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448350.506602:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448350.506608:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.506618:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.506654:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448350.506722:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295313024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 213us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.506742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00010000:00010000:2.0:1789448350.507708:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507739:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507775:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507783:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507790:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507796:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448350.507800:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507809:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507825:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.507832:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc8d1d55/0xe29566c2465fa032 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.507933:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295312896:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 18344us (18865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448350.507943:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1789448350.519994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.520150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295313280 00000100:00100000:3.0:1789448350.520160:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295313280 00000100:00100000:3.0:1789448350.520341:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:3.0:1789448350.520352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10551:x1876372295313280:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789448350.520432:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520448:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520460:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520672:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520691:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520700:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520735:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.520749:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 15 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.520782:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317346432:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448350.521020:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448350.528253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448350.528291:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295313408 00000100:00100000:2.0:1789448350.528300:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295313408 00010000:00010000:2.0:1789448350.528341:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 16 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.528377:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1789448350.528387:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:2350:x1876372295313408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448350.528401:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448350.528408:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 16 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.528421:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 16 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.528442:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:2.0:1789448350.528448:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.528457:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.528482:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.528502:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448350.528552:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:2350:x1876372295313408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 165us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448350.528559:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00010000:00010000:2.0:1789448350.531470:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465f9ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee36 expref: 15 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448350.531494:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317346432:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448350.531517:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.531526:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448350.531532:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448350.532367:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1789448350.532509:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1789448350.532555:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1789448350.533062:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317346560:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789448350.533136:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448350.533169:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e075a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789448350.533491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317346560 00000100:00100000:0.0:1789448350.533499:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317346560 00000100:00100000:0.0:1789448350.533545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448350.533554:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317346560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789448350.533648:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317346560:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.533656:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448350.535326:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789448350.535337:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1789448350.535354:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9ead4d880, transno 4294967309 00000004:00080000:3.0:1789448350.535367:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9ead4ed80, transno 4294967310 00000100:00100000:3.0:1789448350.535374:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317346560:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789448350.535836:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789448350.535907:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317346688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789448350.535954:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448350.535977:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789448350.536570:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317346688 00000100:00100000:0.0:1789448350.536578:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317346688 00000100:00100000:3.0:1789448350.536756:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448350.536766:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317346688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789448350.536934:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1876372317346688:12345-0@lo:1000:mdt00_002.0 Request processed in 170us (978us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789448350.536942:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448350.537012:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317346688:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789448350.537045:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537055:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537063:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537069:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448350.537073:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537080:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537095:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030c00) 00010000:00010000:1.0:1789448350.537098:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448350.537102:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537107:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa040 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537203:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537210:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537844:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537849:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448350.537853:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537859:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:1.0:1789448350.537873:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448350.537880:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537891:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.537900:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.538097:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.538112:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317346816:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448350.539866:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448350.554185:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317346816:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789448350.554243:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554254:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465f9f83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554286:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554316:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554328:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554339:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554345:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554351:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554357:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.554360:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554367:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554377:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448350.554381:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448350.554384:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554390:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa047 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554400:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554414:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554421:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554426:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448350.554429:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554435:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554443:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448350.554445:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448350.554448:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.554454:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448350.554676:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+18:10551:x1876372295313280:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 34325us (34690us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789448350.554695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000020:00080000:3.0:1789448350.554701:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789448350.555082:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789448350.555087:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789448350.555597:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789448350.555606:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789448350.557405:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1789448350.557424:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789448350.557445:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789448350.558719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.558834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295313536 00000100:00100000:0.0:1789448350.558845:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295313536 00000100:00100000:0.0:1789448350.558897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:0.0:1789448350.558908:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:10550:x1876372295313536:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:0.0:1789448350.559046:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:10550:x1876372295313536:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.559053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789448350.561699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.561885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295313792 00000100:00100000:0.0:1789448350.561895:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295313792 00000100:00100000:0.0:1789448350.561951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789448350.561960:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:10551:x1876372295313792:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789448350.562833:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789448350.562933:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789448350.562978:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.562994:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.563014:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.563024:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.563030:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.563037:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.563056:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789448350.563148:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+20:10551:x1876372295313792:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1188us (1464us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789448350.563157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000020:00080000:0.0:1789448350.563162:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789448350.563298:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448350.563306:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.563314:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448350.563324:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.563333:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.563346:0:8432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97d9d0030a00) 00010000:00010000:3.0:1789448350.563349:0:8432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789448350.563354:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.563361:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa04e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448350.563379:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.563380:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448350.563382:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448350.568552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448350.568649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314048 00000100:00100000:3.0:1789448350.568668:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314048 00000100:00100000:3.0:1789448350.568734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:3.0:1789448350.568745:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:10550:x1876372295314048:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:3.0:1789448350.569000:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789448350.569274:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:10550:x1876372295314048:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 531us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448350.569283:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1789448350.612798:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.612933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314176 00000100:00100000:0.0:1789448350.612943:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314176 00000100:00100000:0.0:1789448350.613004:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:0.0:1789448350.613014:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+20:10553:x1876372295314176:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448350.613037:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448350.613059:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee52 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613126:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613140:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613168:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613186:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613194:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613201:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613486:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613499:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613507:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613540:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.613554:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 21 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448350.613567:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317346944:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448350.613640:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4fd1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789448350.620864:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317346944:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448350.620895:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.621927:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448350.622097:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314432 00000100:00100000:0.0:1789448350.622106:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314432 00000100:00100000:0.0:1789448350.622161:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1789448350.622172:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:5589:x1876372295314432:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789448350.622443:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:5589:x1876372295314432:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 272us (519us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789448350.622451:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1789448350.625049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448350.625374:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314560 00000100:00100000:1.0:1789448350.625383:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314560 00010000:00010000:1.0:1789448350.625421:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 23 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448350.625460:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1789448350.625470:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+23:2350:x1876372295314560:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448350.625484:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448350.625491:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 23 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625505:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 23 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625527:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465f9f75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee13 expref: 23 pid: 5833 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625544:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:1.0:1789448350.625549:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625558:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625583:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448350.625628:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448350.625824:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+22:2350:x1876372295314560:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 354us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448350.625832:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00010000:00010000:0.0:1789448350.626035:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626046:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448350.626096:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789448350.626102:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448350.626131:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626144:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626154:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626161:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626179:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626184:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.626188:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626196:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626207:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:0.0:1789448350.626210:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448350.626214:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa05c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626277:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626284:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626290:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626295:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448350.626298:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626314:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626322:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97d9d0030b00) 00010000:00010000:0.0:1789448350.626325:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448350.626329:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626335:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626368:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee52 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626382:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee52 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448350.626389:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448350.626391:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448350.626393:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32800, rc 0) 00000100:00100000:0.0:1789448350.626423:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10553:x1876372295314176:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 13411us (13634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448350.626430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00010000:00010000:3.0:1789448350.877444:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448351.520868:0:12042:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448351.520878:0:12042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448351.520924:0:12042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789448351.520929:0:12042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789448351.577450:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789448351.577458:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789448351.577510:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789448351.577517:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789448351.577662:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317347072:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789448351.577763:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef08ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448351.580847:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317347072:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789448351.585262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448351.585639:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314688 00000100:00100000:3.0:1789448351.585657:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314688 00000100:00100000:3.0:1789448351.585725:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:3.0:1789448351.585736:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10565:x1876372295314688:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789448351.585786:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789448351.585880:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10565:x1876372295314688:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 145us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448351.585887:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:0.0:1789448351.595371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448351.596202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295314944 00000100:00100000:3.0:1789448351.596214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295314944 00000100:00100000:3.0:1789448351.596299:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:3.0:1789448351.596310:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:10565:x1876372295314944:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448351.596330:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448351.596351:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa071 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee59 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.596448:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.596462:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.596475:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448351.596487:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789448351.596635:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa071 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee59 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.596662:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee59 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.596923:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448351.596926:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448351.596930:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26e00, rc 0) 00000100:00100000:3.0:1789448351.596996:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+23:10565:x1876372295314944:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 688us (1634us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789448351.597003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:3.0:1789448351.602055:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448351.602295:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295315072 00000100:00100000:0.0:1789448351.602321:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295315072 00000100:00100000:0.0:1789448351.602385:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789448351.602395:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:2349:x1876372295315072:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448351.602409:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448351.602433:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26e00/0xe29566c2465fa078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee59 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448351.602451:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448351.602456:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448351.602507:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:2349:x1876372295315072:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 113us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448351.602513:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448351.611962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448351.612035:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295315328 00000100:00100000:3.0:1789448351.612045:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295315328 00000100:00100000:3.0:1789448351.612111:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:3.0:1789448351.612122:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+22:10565:x1876372295315328:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789448351.612200:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612241:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612254:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612442:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612451:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612459:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612481:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448351.612486:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612493:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612506:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448351.612509:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448351.612514:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448351.612521:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448351.612669:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+23:10565:x1876372295315328:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 548us (715us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789448351.612687:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 132 00000040:00080000:3.0:1789448351.612802:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448351.612806:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448351.613336:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789448351.613344:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448351.619326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448351.620002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295315584 00000100:00100000:0.0:1789448351.620012:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295315584 00000100:00100000:0.0:1789448351.620069:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1789448351.620078:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:10565:x1876372295315584:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789448351.620336:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+24:10565:x1876372295315584:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 258us (1019us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789448351.620344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00010000:00010000:3.0:1789448351.897444:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448352.537555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317347584:0@lo:400:kworker.0 00000100:00100000:0.0:1789448352.537622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448352.537700:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448352.537706:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317347456:0@lo:400:kworker.0 00000100:00100000:0.0:1789448352.537731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448352.537776:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347584 00000100:00100000:0.0:1789448352.537783:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347584 00000100:00100000:0.0:1789448352.537852:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789448352.537861:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317347584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448352.537913:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317347584:12345-0@lo:400:kworker.0 Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448352.537921:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789448352.537943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347456 00000100:00100000:0.0:1789448352.537947:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347456 00000100:00100000:0.0:1789448352.537973:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789448352.537979:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317347456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448352.538009:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317347456:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448352.538016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1789448352.538032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448352.538036:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448352.538061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317347456:0@lo:400:kworker.0 00000100:00100000:0.0:1789448352.538070:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789448352.538075:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1789448352.538108:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9d0103100, transno 4294967301 00000004:00080000:0.0:1789448352.538116:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789448352.538126:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9d138c700, transno 4294967304 00000100:00100000:0.0:1789448352.538131:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317347584:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538346:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317347328:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538379:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448352.538414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317347840:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448352.538455:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789448352.538461:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317347200:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448352.538507:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317347712:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448352.538556:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347328 00000100:00100000:2.0:1789448352.538559:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347328 00000100:00100000:2.0:1789448352.538584:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347712 00000100:00100000:2.0:1789448352.538587:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347712 00000100:00100000:2.0:1789448352.538610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789448352.538617:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317347328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538665:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317347328:12345-0@lo:400:kworker.0 Request processed in 49us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448352.538683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789448352.538697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789448352.538703:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317347712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538732:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317347712:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448352.538738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1789448352.538766:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448352.538788:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317347712:0@lo:400:kworker.0 00000100:00100000:2.0:1789448352.538796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317347328:0@lo:400:kworker.0 00000100:00100000:1.0:1789448352.538946:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347840 00000100:00100000:1.0:1789448352.538951:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347840 00000100:00100000:1.0:1789448352.538994:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789448352.539002:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317347840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448352.539047:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317347840:12345-0@lo:400:kworker.0 Request processed in 47us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448352.539052:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789448352.539072:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347200 00000100:00100000:1.0:1789448352.539075:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347200 00000100:00100000:1.0:1789448352.539104:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789448352.539111:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448352.539141:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317347200:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448352.539146:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789448352.539190:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317347200:0@lo:400:kworker.0 00000100:00100000:1.0:1789448352.539214:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317347840:0@lo:400:kworker.0 00000100:00080000:2.0:1789448352.539366:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789448352.929487:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448353.049522:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448353.049547:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317347968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448353.049616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448353.049913:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317347968 00000100:00100000:2.0:1789448353.049921:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317347968 00000100:00100000:2.0:1789448353.049974:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789448353.049984:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317347968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448353.050020:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448353.050117:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317347968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448353.050124:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448353.055400:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317347968:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789448353.538029:0:12093:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789448353.538038:0:12093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789448353.538086:0:12093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789448353.538092:0:12093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448353.571969:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448353.572043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448353.572139:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348096 00000100:00100000:2.0:1789448353.572147:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348096 00000100:00100000:2.0:1789448353.572197:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448353.572207:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f53ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448353.572387:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448353.572438:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f53ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448353.572445:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448353.572710:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448353.755758:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448353.756946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295315840 00000100:00100000:3.0:1789448353.756965:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295315840 00000100:00100000:3.0:1789448353.757081:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:3.0:1789448353.757093:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+24:10586:x1876372295315840:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448353.757121:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448353.757144:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa08d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee60 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448353.757276:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fa094 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448353.757291:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fa094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448353.757306:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fa094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448353.757321:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789448353.757464:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa08d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee60 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448353.757482:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fa094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee60 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448353.757490:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448353.757494:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789448353.757498:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27000, rc 0) 00000100:00100000:3.0:1789448353.758995:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+26:10586:x1876372295315840:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1896us (3237us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789448353.759007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00080000:2.0:1789448353.759187:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448353.764465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448353.764592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295315968 00000100:00100000:0.0:1789448353.764626:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295315968 00000100:00100000:0.0:1789448353.764708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:0.0:1789448353.764719:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:10586:x1876372295315968:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789448353.764796:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764814:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764827:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764852:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764859:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764866:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764872:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448353.764876:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764884:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764894:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:0.0:1789448353.764897:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448353.764902:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448353.764918:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448353.764990:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:10586:x1876372295315968:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 273us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448353.764997:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:1.0:1789448353.870187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448353.870522:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316096 00000100:00100000:0.0:1789448353.870536:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316096 00000100:00100000:1.0:1789448353.870832:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1789448353.870959:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295316096:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789448353.870987:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448353.871077:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000779113/0xe29566c2465fa0a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee67 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448353.871117:0:10266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8d09d, atime: 0x6aa8d09d, ctime: 0x6aa8d09d, blocks: 0xb 00010000:00010000:1.0:1789448353.871145:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789448353.871151:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448353.871162:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000779113/0xe29566c2465fa0a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee67 expref: 7 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448353.871185:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000779113/0xe29566c2465fa0a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee67 expref: 7 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448353.871203:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34800, rc 0) 00000100:00080000:2.0:1789448353.871365:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448353.871464:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295316096:12345-192.168.202.54@tcp:101:cat.0 Request processed in 621us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448353.871473:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1789448353.876738:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448353.878651:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316224 00000100:00100000:3.0:1789448353.878673:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316224 00002000:00100000:3.0:1789448353.878749:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97da01c50380 x1876372295316224/t0(0) o3->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:214/0 lens 488/0 e 0 to 0 dl 1789448364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448353.878762:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97da01c50380 with x1876372295316224 ext(0->4095) 00002000:00010000:3.0:1789448353.878771:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97da01c50380 00000100:00100000:3.0:1789448353.878820:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:3.0:1789448353.878833:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295316224:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:0.0:1789448353.881726:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295316224:12345-192.168.202.54@tcp:3:cat.0 Request processed in 2885us (4993us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789448353.881744:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00002000:00100000:0.0:1789448353.881756:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97da01c50380 x1876372295316224/t0(0) o3->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:214/0 lens 488/4536 e 0 to 0 dl 1789448364 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789448353.881766:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97da01c50380 with x1876372295316224 ext(0->4095) 00002000:00010000:0.0:1789448353.881773:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97da01c50380 00010000:00010000:3.0:1789448353.946453:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448354.753596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448354.753688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448354.753725:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448354.753748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448354.753772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448354.757248:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316736 00000100:00100000:2.0:1789448354.757264:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316736 00000100:00100000:2.0:1789448354.757328:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316608 00000100:00100000:2.0:1789448354.757332:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316608 00000100:00100000:2.0:1789448354.757370:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1789448354.757381:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295316736:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448354.757468:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295316736:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 89us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448354.757476:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1789448354.757493:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1789448354.757499:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295316608:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448354.757521:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295316608:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448354.757526:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00080000:2.0:1789448354.757546:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448354.757722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316352 00000100:00100000:2.0:1789448354.757727:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316352 00000100:00100000:2.0:1789448354.757762:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:2.0:1789448354.757767:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295316352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448354.757794:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295316352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448354.757800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:0.0:1789448354.763697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316480 00000100:00100000:0.0:1789448354.763710:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316480 00000100:00100000:0.0:1789448354.763779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316864 00000100:00100000:0.0:1789448354.763784:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316864 00000100:00100000:0.0:1789448354.763830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:0.0:1789448354.763841:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+26:2348:x1876372295316480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448354.763927:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+26:2348:x1876372295316480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 88us (10341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448354.771132:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:3.0:1789448354.771156:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295316864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448354.771253:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295316864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 108us (17479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448354.771264:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00080000:3.0:1789448354.773199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448354.774052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00010000:00010000:1.0:1789448354.972794:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789448355.648001:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1789448355.648039:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789448355.648060:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9eafd5540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789448355.648066:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d8c2026e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9eafd50c0 00000020:00080000:3.0:1789448355.648070:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d8c2026b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9e7a57800 00000020:00080000:3.0:1789448355.648107:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789448355.649985:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789448355.650181:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1789448355.655865:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789448355.655884:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789448355.994190:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448357.018530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448357.660991:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317348480:0@lo:400:kworker.0 00000100:00100000:2.0:1789448357.661023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317348352:0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.661060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448357.661092:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348480 00000100:00100000:2.0:1789448357.661100:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348480 00000100:00100000:2.0:1789448357.661166:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789448357.661176:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317348480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448357.661511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317348224:0@lo:400:kworker.0 00000100:00100000:3.0:1789448357.661556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448357.662341:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317348480:12345-0@lo:400:kworker.0 Request processed in 1164us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448357.662351:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789448357.662368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348608:0@lo:400:kworker.0 00000100:00080000:2.0:1789448357.662381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448357.662402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448357.662414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448357.662446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348352 00000100:00100000:2.0:1789448357.662689:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348352 00000100:00100000:2.0:1789448357.662780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789448357.662789:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448357.662837:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317348352:12345-0@lo:400:kworker.0 Request processed in 50us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448357.662843:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789448357.666445:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317348480:0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.666501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348224 00000100:00100000:0.0:1789448357.666509:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348224 00000100:00100000:0.0:1789448357.666567:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789448357.666576:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317348224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.666768:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317348224:12345-0@lo:400:kworker.0 Request processed in 191us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448357.666776:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789448357.666896:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317348224:0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.668194:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317348736:0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.668275:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448357.673528:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348736 00000100:00100000:0.0:1789448357.673530:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448357.673542:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348736 00000100:00100000:0.0:1789448357.673548:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317348864:0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.673618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448357.673621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789448357.673631:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.673656:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348608 00000100:00100000:0.0:1789448357.673659:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348608 00000100:00100000:0.0:1789448357.673687:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348864 00000100:00100000:0.0:1789448357.673690:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348864 00000100:00100000:3.0:1789448357.673692:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317348736:12345-0@lo:400:kworker.0 Request processed in 63us (5417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448357.673699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789448357.673711:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789448357.673717:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789448357.673725:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448357.673728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789448357.673731:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448357.673760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317348736:0@lo:400:kworker.0 00000100:00100000:2.0:1789448357.673841:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448357.673851:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317348864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448357.674499:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348608:12345-0@lo:400:kworker.0 Request processed in 779us (12084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448357.674508:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789448357.674705:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348608:0@lo:400:kworker.0 00000100:00100000:2.0:1789448357.674815:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317348864:12345-0@lo:400:kworker.0 Request processed in 965us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448357.674832:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448357.674861:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317348352:0@lo:400:kworker.0 00000100:00100000:3.0:1789448357.674910:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789448357.674916:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789448357.674930:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317348864:0@lo:400:kworker.0 00010000:00010000:3.0:1789448358.041614:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448358.169920:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448358.169943:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448358.170004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448358.170134:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317348992 00000100:00100000:0.0:1789448358.170149:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317348992 00000100:00100000:0.0:1789448358.170203:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789448358.170212:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448358.170259:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448358.170310:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317348992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448358.170316:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789448358.170646:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317348992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448358.596564:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448358.598799:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295316992 00000100:00100000:3.0:1789448358.598815:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295316992 00000100:00100000:3.0:1789448358.598905:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:3.0:1789448358.598916:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10239:x1876372295316992:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789448358.599562:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10239:x1876372295316992:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 644us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448358.599572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00080000:2.0:1789448358.599779:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448358.603569:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448358.603760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317248 00000100:00100000:0.0:1789448358.603771:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317248 00000100:00100000:0.0:1789448358.603834:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789448358.603854:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:10239:x1876372295317248:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789448358.604678:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:10239:x1876372295317248:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 831us (1116us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789448358.604688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:1.0:1789448358.683127:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448358.683163:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317349120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448358.683252:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448358.683526:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349120 00000100:00100000:2.0:1789448358.683536:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349120 00000100:00100000:2.0:1789448358.683603:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789448358.683613:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317349120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448358.683649:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448358.683712:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317349120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448358.683718:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448358.683896:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317349120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448359.068734:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789448359.833656:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448359.833666:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448359.833904:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789448359.833911:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789448359.875781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448359.875826:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448359.875864:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448359.875891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448359.875919:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317632 00000100:00100000:0.0:1789448359.875919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448359.875929:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317632 00000100:00100000:0.0:1789448359.875939:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317888 00000100:00100000:0.0:1789448359.875942:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317888 00000100:00100000:1.0:1789448359.875983:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317760 00000100:00100000:0.0:1789448359.875983:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317504 00000100:00100000:1.0:1789448359.875986:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317760 00000100:00100000:0.0:1789448359.875986:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317504 00000100:00100000:1.0:1789448359.876006:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1789448359.876006:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:1.0:1789448359.876013:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295317632:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448359.876024:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295317888:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448359.876077:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2350:x1876372295317888:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448359.876085:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:0.0:1789448359.876102:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:0.0:1789448359.876114:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2350:x1876372295317504:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448359.876155:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295317376 00000100:00100000:2.0:1789448359.876159:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295317376 00000100:00100000:2.0:1789448359.876188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:2.0:1789448359.876195:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295317376:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448359.876200:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:3.0:1789448359.876209:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295317760:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448359.876253:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295317632:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 239us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448359.876258:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295317760:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448359.876261:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:3.0:1789448359.876264:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00080000:1.0:1789448359.876280:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448359.876284:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448359.876286:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448359.877500:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2350:x1876372295317504:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1384us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448359.877511:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:2.0:1789448359.882848:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295317376:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 6641us (7065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448359.882863:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 294 00010000:00010000:3.0:1789448360.090386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789448360.777048:0:12292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:59:19 (1789448359) 00000001:00080000:3.0:1789448360.790323:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789448360.790334:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789448360.790351:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789448360.790361:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789448361.115144:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448362.003690:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448362.003794:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318144 00000100:00100000:0.0:1789448362.003804:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318144 00000100:00100000:0.0:1789448362.003924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:0.0:1789448362.003934:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+13:11297:x1876372295318144:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448362.003953:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448362.003974:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee6e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004042:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004057:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004070:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004084:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004106:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004114:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004448:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004459:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004468:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448362.004478:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789448362.004649:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004657:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004664:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004671:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448362.004676:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004683:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004707:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:0.0:1789448362.004710:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448362.004717:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004723:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa0b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004736:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004743:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004748:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004754:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448362.004757:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004763:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004770:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97d9d0030000) 00010000:00010000:0.0:1789448362.004773:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448362.004776:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.004782:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.005150:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee6e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.005166:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee6e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448362.005175:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:0.0:1789448362.005177:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448362.005180:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448362.005284:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+15:11297:x1876372295318144:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1351us (1604us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789448362.005293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00080000:1.0:1789448362.009894:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448362.014631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448362.014734:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318400 00000100:00100000:1.0:1789448362.014746:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318400 00000100:00100000:1.0:1789448362.014814:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448362.014825:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:2351:x1876372295318400:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448362.014840:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448362.014864:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee6e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448362.014897:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:1.0:1789448362.014902:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448362.014961:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2351:x1876372295318400:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 137us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448362.014968:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1789448362.016929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448362.017010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318272 00000100:00100000:1.0:1789448362.017025:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318272 00000100:00100000:1.0:1789448362.017086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:1.0:1789448362.017096:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11297:x1876372295318272:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789448362.017255:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11297:x1876372295318272:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448362.017264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00010000:00010000:1.0:1789448362.139717:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448362.777940:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317349504:0@lo:400:kworker.0 00000100:00100000:1.0:1789448362.778039:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448362.778112:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448362.778117:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317349632:0@lo:400:kworker.0 00000100:00100000:1.0:1789448362.778144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448362.778186:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349632 00000100:00100000:1.0:1789448362.778195:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349632 00000100:00100000:1.0:1789448362.778287:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789448362.778299:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317349632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448362.778353:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317349632:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448362.778376:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789448362.778402:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448362.778439:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317349632:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.778748:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317349248:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.778798:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448362.778836:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317349760:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.778867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448362.778887:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789448362.778892:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317349376:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.778910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448362.778925:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317349888:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.778942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448362.778967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349504 00000100:00100000:3.0:1789448362.778972:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349504 00000100:00100000:3.0:1789448362.779004:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349760 00000100:00100000:3.0:1789448362.779016:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349760 00000100:00100000:3.0:1789448362.779030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349376 00000100:00100000:3.0:1789448362.779032:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349376 00000100:00100000:3.0:1789448362.779045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789448362.779051:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317349504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779086:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317349504:12345-0@lo:400:kworker.0 Request processed in 35us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448362.779092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789448362.779103:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789448362.779108:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317349760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779131:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317349760:12345-0@lo:400:kworker.0 Request processed in 23us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448362.779137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789448362.779145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789448362.779150:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317349376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779169:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317349376:12345-0@lo:400:kworker.0 Request processed in 19us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448362.779184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789448362.779203:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349888 00000100:00100000:3.0:1789448362.779207:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349888 00000100:00100000:3.0:1789448362.779259:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789448362.779266:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779294:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317349888:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448362.779300:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789448362.779324:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317349376:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779333:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317349888:0@lo:400:kworker.0 00000100:00100000:3.0:1789448362.779341:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317349760:0@lo:400:kworker.0 00000100:00100000:1.0:1789448362.781162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317349248 00000100:00100000:1.0:1789448362.781181:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317349248 00000100:00100000:1.0:1789448362.781277:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789448362.781289:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317349248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448362.781412:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317349248:12345-0@lo:400:kworker.0 Request processed in 124us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448362.781419:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1789448362.781456:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448362.781463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448362.781492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317349248:0@lo:400:kworker.0 00000100:00100000:0.0:1789448362.781494:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317349504:0@lo:400:kworker.0 00000040:00080000:0.0:1789448362.907960:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448362.907974:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448362.908030:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789448362.908038:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789448363.168701:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448363.301242:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317350016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448363.301342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448363.301436:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317350016 00000100:00100000:2.0:1789448363.301446:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317350016 00000100:00100000:2.0:1789448363.301505:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448363.301516:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317350016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448363.301600:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448363.301655:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317350016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448363.301664:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448363.301722:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317350016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448363.801438:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448363.801465:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317350144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448363.801553:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448363.801626:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317350144 00000100:00100000:2.0:1789448363.801634:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317350144 00000100:00100000:2.0:1789448363.801681:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448363.801690:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317350144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448363.801728:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448363.801774:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317350144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448363.801781:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448363.801833:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eac8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317350144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448364.147144:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.147399:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318528 00000100:00100000:0.0:1789448364.147410:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318528 00000100:00100000:0.0:1789448364.147486:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:0.0:1789448364.147498:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11339:x1876372295318528:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448364.147520:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448364.147553:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee75 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789448364.147595:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789448364.147703:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147720:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147735:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147751:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147758:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147766:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147953:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147961:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147968:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147975:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448364.147979:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.147996:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148009:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:0.0:1789448364.148012:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.148017:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148023:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa0da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148034:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148039:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148044:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148049:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448364.148052:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148058:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148066:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97d9d0030000) 00010000:00010000:0.0:1789448364.148068:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.148071:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148088:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa0e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148133:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee75 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148143:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:0.0:1789448364.148146:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.148150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee75 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.148160:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32000, rc 0) 00000100:00100000:0.0:1789448364.148263:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11339:x1876372295318528:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 767us (1128us total) trans 0 rc 301/301 00000100:00100000:0.0:1789448364.148270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:0.0:1789448364.169103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.169410:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318784 00000100:00100000:1.0:1789448364.169422:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318784 00000100:00100000:1.0:1789448364.169519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:1.0:1789448364.169530:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11339:x1876372295318784:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:1.0:1789448364.169615:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448364.169646:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465f9a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecb5 expref: 14 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169662:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5ca00) 00010000:00010000:1.0:1789448364.169674:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448364.169904:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169917:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169940:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169954:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.169968:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448364.171770:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789448364.171787:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171797:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171804:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171810:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448364.171814:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171823:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171837:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6200) 00010000:00010000:1.0:1789448364.171840:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448364.171853:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.171860:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa0e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448364.171878:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000993ffd40 reply state 00000000a5465673 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.171885:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448364.172029:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+15:11339:x1876372295318784:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 2497us (2928us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789448364.172038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00010000:00010000:0.0:1789448364.173945:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.173961:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.173969:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.173975:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448364.173980:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.174005:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.174022:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97d9e0bd6500) 00010000:00010000:0.0:1789448364.174025:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.174030:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.174036:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa0ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.188076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448364.282200:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448364.282800:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295318912 00000100:00100000:3.0:1789448364.282877:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295318912 00000100:00100000:3.0:1789448364.284106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:3.0:1789448364.284122:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:11347:x1876372295318912:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:3.0:1789448364.284149:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448364.284172:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee7c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284262:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284276:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284301:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448364.284337:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789448364.284340:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448364.284357:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284378:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26200/0xe29566c2465fa0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee7c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284393:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee7c expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.284401:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:3.0:1789448364.284403:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448364.284407:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27a00, rc 0) 00000100:00100000:3.0:1789448364.284473:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+15:11347:x1876372295318912:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 357us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448364.284480:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:3.0:1789448364.381723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.382029:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319040 00000100:00100000:0.0:1789448364.382039:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319040 00000100:00100000:0.0:1789448364.382106:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:0.0:1789448364.382117:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+15:11353:x1876372295319040:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448364.382140:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448364.382165:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee83 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382288:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382303:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382330:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382347:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382371:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382378:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382473:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382481:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382488:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448364.382516:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789448364.382519:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448364.382551:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382564:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382571:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382577:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382584:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448364.382588:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382602:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382614:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:0.0:1789448364.382617:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.382623:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382630:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382642:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382649:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382654:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382660:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448364.382663:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382670:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382676:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97d9d0030000) 00010000:00010000:0.0:1789448364.382679:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448364.382682:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382710:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa112 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382755:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee83 expref: 17 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382769:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee83 expref: 16 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.382776:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448364.382778:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789448364.382781:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33000, rc 0) 00000100:00100000:0.0:1789448364.383030:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+16:11353:x1876372295319040:12345-192.168.202.54@tcp:101:bash.0 Request processed in 732us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448364.383038:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:0.0:1789448364.389742:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.394584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319296 00000100:00100000:1.0:1789448364.394600:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319296 00000100:00100000:1.0:1789448364.394676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:1.0:1789448364.394696:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+16:11353:x1876372295319296:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448364.394719:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448364.394741:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa120 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee8a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.394893:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.394910:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.394923:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.394963:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.394985:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.395005:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448364.396172:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789448364.396549:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396563:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396573:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396611:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396618:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396624:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396630:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448364.396634:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396641:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396667:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448364.396670:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448364.396675:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa127 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448364.396710:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055bfeba3 reply state 000000004acac349 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.396719:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789448364.396757:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa120 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396772:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.396780:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448364.396783:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448364.396786:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35000, rc 0) 00000100:00100000:1.0:1789448364.397669:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11353:x1876372295319296:12345-192.168.202.54@tcp:101:bash.0 Request processed in 2979us (7934us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789448364.397680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00010000:00010000:1.0:1789448364.400702:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400722:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400751:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400757:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448364.400762:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400770:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400788:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9e0bd6200) 00010000:00010000:1.0:1789448364.400791:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448364.400796:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.400802:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa12e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448364.408173:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.408416:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319424 00000100:00100000:1.0:1789448364.408426:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319424 00000100:00100000:1.0:1789448364.408509:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:1.0:1789448364.408520:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295319424:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448364.408549:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448364.408578:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee91 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448364.408608:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789448364.408630:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1789448364.408644:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448364.408653:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.408674:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.408759:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35200, rc 0) 00000100:00100000:1.0:1789448364.408880:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2349:x1876372295319424:12345-192.168.202.54@tcp:101:bash.0 Request processed in 361us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.408887:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00080000:2.0:1789448364.409831:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448364.415801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448364.415893:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319552 00000100:00100000:3.0:1789448364.415904:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319552 00000100:00100000:3.0:1789448364.415961:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789448364.415970:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+6:11353:x1876372295319552:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789448364.415996:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448364.416015:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.416058:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.416068:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448364.416072:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448364.416077:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.416107:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.416121:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448364.416136:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1876372317350272:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448364.416262:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789448364.425047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448364.425156:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1876372317350272:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448364.425190:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.425213:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26200, rc 0) 00000100:00100000:3.0:1789448364.425298:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:11353:x1876372295319552:12345-192.168.202.54@tcp:101:bash.0 Request processed in 9328us (9506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448364.425308:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1789448364.425429:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319680 00000100:00100000:1.0:1789448364.425437:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319680 00010000:00010000:1.0:1789448364.425471:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.425506:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:1.0:1789448364.425515:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295319680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448364.425539:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448364.425573:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.425585:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.425608:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa143 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee91 expref: 7 pid: 6672 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.425632:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448364.425637:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448364.425646:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.425658:0:7613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.425695:0:7613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.425708:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4db9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7613:1876372317350400:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448364.425759:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448364.430679:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4db9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7613:1876372317350400:192.168.202.54@tcp:105: 00010000:00010000:1.0:1789448364.430713:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448364.430782:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295319680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5266us (5742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.430793:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789448364.431024:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.431127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295319936 00000100:00100000:2.0:1789448364.431137:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295319936 00000100:00100000:2.0:1789448364.431197:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1789448364.431207:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11353:x1876372295319936:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789448364.431594:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11353:x1876372295319936:12345-192.168.202.54@tcp:35:bash.0 Request processed in 387us (569us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789448364.431618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:0.0:1789448364.511269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.511385:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295320192 00000100:00100000:2.0:1789448364.511398:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295320192 00000100:00100000:2.0:1789448364.511465:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:2.0:1789448364.511478:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11363:x1876372295320192:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448364.511507:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448364.511538:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ee9f expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448364.511635:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789448364.511763:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa151 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee9f expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.511778:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:2.0:1789448364.511781:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448364.511786:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee9f expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.511803:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3400, rc 0) 00000100:00100000:2.0:1789448364.511944:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11363:x1876372295320192:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 468us (686us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789448364.511953:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:1.0:1789448364.515494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.515789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295320448 00000100:00100000:2.0:1789448364.515801:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295320448 00000100:00100000:2.0:1789448364.515876:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789448364.515888:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11363:x1876372295320448:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448364.516190:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11363:x1876372295320448:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 304us (705us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789448364.516198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1789448364.657311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.660165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295320576 00000100:00100000:1.0:1789448364.660181:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295320576 00000100:00100000:1.0:1789448364.660329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:1.0:1789448364.660341:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11369:x1876372295320576:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448364.660368:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448364.660405:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eea6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660479:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660495:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660509:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448364.660556:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789448364.660561:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448364.660580:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660608:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eea6 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660629:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eea6 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.660637:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448364.660640:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448364.660644:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34e00, rc 0) 00000100:00100000:1.0:1789448364.660719:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11369:x1876372295320576:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 380us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.660727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:3.0:1789448364.676144:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.676600:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295320832 00000100:00100000:2.0:1789448364.676613:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295320832 00000100:00100000:2.0:1789448364.676681:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:2.0:1789448364.676693:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11369:x1876372295320832:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448364.676715:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448364.676737:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa16d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eead expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.676861:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.676875:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.676886:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448364.676898:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789448364.677042:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa16d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eead expref: 25 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.677073:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eead expref: 24 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.677083:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:2.0:1789448364.677100:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448364.677104:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448364.677171:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11369:x1876372295320832:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 480us (1035us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789448364.677178:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:2.0:1789448364.683656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.683805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.685968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321216 00000100:00100000:0.0:1789448364.685988:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321216 00000100:00100000:0.0:1789448364.686085:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:0.0:1789448364.686097:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11369:x1876372295321216:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448364.686124:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448364.686163:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa182 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eeb4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.686286:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.686301:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.686313:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448364.686326:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789448364.686451:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa182 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeb4 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.686473:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeb4 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.686482:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:0.0:1789448364.686486:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789448364.686489:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33200, rc 0) 00000100:00100000:0.0:1789448364.686577:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11369:x1876372295321216:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 482us (2772us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789448364.686586:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:1.0:1789448364.688371:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295320960 00000100:00100000:1.0:1789448364.688399:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295320960 00000100:00100000:1.0:1789448364.688467:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448364.688477:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+26:2351:x1876372295320960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448364.688491:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448364.688515:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eead expref: 26 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.688547:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448364.688552:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448364.688612:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+25:2351:x1876372295320960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 137us (4966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.688619:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789448364.698749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.698889:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321344 00000100:00100000:1.0:1789448364.698901:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321344 00000100:00100000:1.0:1789448364.698983:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789448364.698996:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295321344:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:1.0:1789448364.699063:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.699086:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.699096:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448364.699101:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448364.699106:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.699163:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.699178:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 6 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.699195:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4db8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317350528:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448364.699501:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448364.705148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.705172:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4db8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317350528:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448364.705245:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321472 00000100:00100000:0.0:1789448364.705253:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321472 00002000:00100000:0.0:1789448364.705298:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97d9ead57800 x1876372295321472/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:225/0 lens 504/0 e 0 to 0 dl 1789448375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789448364.705309:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead57800 with x1876372295321472 ext(0->12) 00010000:00010000:0.0:1789448364.705329:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 7 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.705346:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 7 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448364.705355:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead57800 00000100:00100000:0.0:1789448364.705391:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789448364.705401:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295321472:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:0.0:1789448364.705893:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295321472:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 492us (755us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789448364.705902:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:0.0:1789448364.705910:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97d9ead57800 x1876372295321472/t4294967305(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:225/0 lens 504/448 e 0 to 0 dl 1789448375 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789448364.705918:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead57800 with x1876372295321472 ext(0->12) 00010000:00010000:0.0:1789448364.705925:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.705937:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448364.705945:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead57800 00010000:00010000:1.0:1789448364.706169:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448364.709339:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.709452:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321600 00000100:00100000:0.0:1789448364.709463:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321600 00010000:00010000:0.0:1789448364.709501:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448364.709589:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789448364.709600:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295321600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448364.709618:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789448364.709638:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789448364.709641:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789448364 00002000:00010000:0.0:1789448364.709644:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789448364 00002000:00010000:0.0:1789448364.709646:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789448364 00010000:00010000:0.0:1789448364.709652:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.709665:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.709688:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa14a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee98 expref: 9 pid: 6671 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.709705:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789448364.709710:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789448364.709715:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.709725:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.709758:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448364.709834:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295321600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 235us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448364.709842:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00010000:00010000:2.0:1789448364.709981:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.709992:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710018:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710027:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710037:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710045:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448364.710050:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710070:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710083:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.710092:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46f9084/0xe29566c2465fa197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448364.710139:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295321344:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 11148us (11402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448364.710147:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789448364.716863:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448364.716968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321856 00000100:00100000:3.0:1789448364.716990:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321856 00000100:00100000:3.0:1789448364.717057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789448364.717069:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c86b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+25:11369:x1876372295321856:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:3.0:1789448364.717131:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeb4 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789448364.717422:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789448364.717470:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789448364.718281:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789448364.718343:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.718359:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.718368:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.718403:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.718418:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 29 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448364.718445:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb037100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317350656:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448364.718544:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448364.722441:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.722515:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295321984 00000100:00100000:1.0:1789448364.722523:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295321984 00000100:00100000:2.0:1789448364.722564:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb037100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317350656:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448364.722584:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 30 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.722603:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.722636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:1.0:1789448364.722646:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+30:2350:x1876372295321984:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448364.722661:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448364.722668:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 30 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722681:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 30 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722716:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee8a expref: 30 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722731:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448364.722736:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722745:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722752:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.722780:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448364.722805:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.722814:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448364.723120:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789448364.723339:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789448364.723457:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317350784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789448364.733214:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+31:2350:x1876372295321984:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10555us (10768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.733254:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:2.0:1789448364.734228:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448364.734261:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c85e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789448364.734357:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317350784 00000100:00100000:0.0:1789448364.734367:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317350784 00000100:00100000:0.0:1789448364.734434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448364.734444:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317350784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789448364.734544:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317350784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448364.734552:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789448364.734621:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448364.734693:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317350784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789448364.736261:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789448364.736344:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317350912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789448364.736397:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448364.736506:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c85e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448364.737071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317350912 00000100:00100000:3.0:1789448364.737080:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317350912 00000100:00100000:3.0:1789448364.737180:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448364.737190:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876372317350912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789448364.737402:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1876372317350912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 214us (1003us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789448364.737410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789448364.737504:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d1015880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317350912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789448364.737594:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789448364.737634:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737644:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737651:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737657:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448364.737662:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737670:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737687:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:2.0:1789448364.737690:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789448364.737694:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.737717:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fa19e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789448364.738315:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789448364.738461:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789448364.738470:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386441252363ns, next at 387441250636ns, rc = 0 00000001:00080000:2.0:1789448364.738478:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789448364.738514:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:2.0:1789448364.738518:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789448364.738525:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa189 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeb4 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448364.738754:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c86b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11369:x1876372295321856:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 21687us (21911us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789448364.738763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000020:00080000:2.0:1789448364.738768:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789448364.741360:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.741539:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295322112 00000100:00100000:2.0:1789448364.741549:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295322112 00000100:00100000:2.0:1789448364.741614:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:2.0:1789448364.741625:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11369:x1876372295322112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448364.741649:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448364.741671:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa1a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eebb expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.741733:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eebb expref: 33 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.741767:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eebb expref: 33 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.741788:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448364.741791:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448364.741794:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448364.742013:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11369:x1876372295322112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 389us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448364.742020:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:1.0:1789448364.745917:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.746028:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295322368 00000100:00100000:0.0:1789448364.746038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295322368 00000100:00100000:0.0:1789448364.746091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1789448364.746102:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11369:x1876372295322368:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448364.746769:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11369:x1876372295322368:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 666us (858us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789448364.746777:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789448364.868169:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.868272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295322624 00000100:00100000:0.0:1789448364.868282:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295322624 00000100:00100000:0.0:1789448364.868338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:0.0:1789448364.868349:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11379:x1876372295322624:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448364.868374:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448364.868394:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa1ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eec2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448364.868481:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789448364.868761:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa1ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec2 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.868790:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:0.0:1789448364.868793:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448364.868798:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa1ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec2 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448364.868811:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448364.868874:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11379:x1876372295322624:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 526us (713us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789448364.868880:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:3.0:1789448364.873041:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.873137:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295322752 00000100:00100000:2.0:1789448364.873147:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295322752 00000100:00100000:2.0:1789448364.873204:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:2.0:1789448364.873213:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11379:x1876372295322752:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789448364.873324:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873340:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873352:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873366:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873373:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873398:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873487:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873495:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.873503:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448364.873567:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874084:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874094:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874102:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874109:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448364.874114:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874122:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874136:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448364.874150:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448364.874156:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874164:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa1ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874185:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874191:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874198:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874203:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448364.874206:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874212:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874302:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311000) 00010000:00010000:2.0:1789448364.874304:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448364.874308:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874314:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa1c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874329:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874341:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874346:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874351:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448364.874354:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874360:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874367:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448364.874370:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448364.874372:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448364.874378:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448364.874743:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11379:x1876372295322752:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1527us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448364.874752:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:1.0:1789448364.879174:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448364.879439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323008 00000100:00100000:0.0:1789448364.879448:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323008 00000100:00100000:0.0:1789448364.879542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:0.0:1789448364.879780:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11379:x1876372295323008:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448364.880139:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+36:11379:x1876372295323008:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 586us (974us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789448364.880147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:0.0:1789448364.915748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448364.915833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323264 00000100:00100000:3.0:1789448364.915844:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323264 00000100:00100000:3.0:1789448364.915902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1789448364.915912:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+36:11382:x1876372295323264:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448364.915935:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448364.915956:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa1cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eec9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916043:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916060:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916089:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916105:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916119:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916428:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916437:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916444:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448364.916454:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789448364.916676:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916684:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916690:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916695:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448364.916706:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916714:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916725:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448364.916728:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448364.916732:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916738:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa1d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916751:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916758:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916764:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916770:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448364.916773:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916779:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916785:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448364.916788:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448364.916797:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916802:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa1dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916844:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa1cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916859:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448364.916866:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448364.916869:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448364.916871:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448364.916939:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11382:x1876372295323264:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1027us (1199us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789448364.916947:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1789448364.922118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448364.922346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323392 00000100:00100000:1.0:1789448364.922356:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323392 00000100:00100000:1.0:1789448364.922416:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:1.0:1789448364.922425:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11382:x1876372295323392:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1789448364.922493:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922511:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922549:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922587:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922594:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922601:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922608:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448364.922928:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922939:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922952:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:1.0:1789448364.922955:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448364.922959:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448364.922966:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34000/0xe29566c2465fa1f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448364.923052:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11382:x1876372295323392:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 626us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448364.923061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:1.0:1789448364.926108:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448364.926243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323648 00000100:00100000:2.0:1789448364.926254:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323648 00000100:00100000:2.0:1789448364.926309:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:2.0:1789448364.926319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11382:x1876372295323648:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448364.926748:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+39:11382:x1876372295323648:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 429us (647us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789448364.926764:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1789448365.000894:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.000944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.000978:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448365.001120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295324032 00000100:00100000:3.0:1789448365.001130:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295324032 00000100:00100000:3.0:1789448365.001207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:3.0:1789448365.001250:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295324032:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448365.001323:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295324032:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 107us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448365.001331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:2.0:1789448365.001418:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323776 00000100:00100000:2.0:1789448365.001428:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323776 00000100:00100000:2.0:1789448365.001468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:2.0:1789448365.001475:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295323776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448365.001505:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295323776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448365.001512:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:1.0:1789448365.001681:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295323904 00000100:00100000:1.0:1789448365.001686:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295323904 00000100:00100000:1.0:1789448365.001728:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:1.0:1789448365.001746:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295323904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448365.001774:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2348:x1876372295323904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448365.001781:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00080000:0.0:1789448365.002321:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448365.002326:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448365.209518:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448365.213867:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448365.213977:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295324288 00000100:00100000:2.0:1789448365.213989:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295324288 00000100:00100000:2.0:1789448365.214049:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:2.0:1789448365.214059:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+39:11413:x1876372295324288:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789448365.214085:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448365.214106:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eed0 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.214206:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.214253:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.214267:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448365.214278:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789448365.214400:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed0 expref: 42 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.214443:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed0 expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.214452:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448365.214456:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448365.214459:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2600, rc 0) 00000100:00100000:2.0:1789448365.214521:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+41:11413:x1876372295324288:12345-192.168.202.54@tcp:101:cat.0 Request processed in 463us (664us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789448365.214537:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:1.0:1789448365.221596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448365.221647:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448365.221731:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295324672 00000100:00100000:2.0:1789448365.221742:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295324672 00000100:00100000:2.0:1789448365.221801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:2.0:1789448365.221811:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+41:11413:x1876372295324672:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:2.0:1789448365.222047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+42:11413:x1876372295324672:12345-192.168.202.54@tcp:35:cat.0 Request processed in 236us (399us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789448365.222053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:0.0:1789448365.222122:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295324416 00000100:00100000:0.0:1789448365.222126:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295324416 00000100:00100000:0.0:1789448365.222167:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789448365.222173:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+42:2350:x1876372295324416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448365.222198:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448365.222249:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed0 expref: 42 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.222266:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448365.222271:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448365.222289:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+41:2350:x1876372295324416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 117us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448365.222295:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789448365.305975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448365.306130:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295324928 00000100:00100000:3.0:1789448365.306153:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295324928 00000100:00100000:3.0:1789448365.306244:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:3.0:1789448365.306255:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+41:11419:x1876372295324928:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:3.0:1789448365.306279:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448365.306283:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789448365.306312:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eea6 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306333:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448365.306337:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448365.306350:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa20e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eed7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306454:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306469:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306477:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306512:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.306539:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 41 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448365.306563:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317351040:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448365.307048:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448365.312938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.313017:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295325056 00000100:00100000:0.0:1789448365.313027:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295325056 00010000:00010000:0.0:1789448365.313068:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 42 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448365.313113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789448365.313123:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+42:2351:x1876372295325056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448365.313138:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448365.313146:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 42 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.313160:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 42 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.313182:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448365.313188:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.313212:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.313253:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.313274:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448365.313328:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+42:2351:x1876372295325056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448365.313336:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00010000:00010000:3.0:1789448365.313447:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa1e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eec9 expref: 41 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448365.313464:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317351040:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448365.313487:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.313496:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.313503:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448365.313533:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789448365.313710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa20e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.313726:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.313734:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448365.313737:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789448365.313740:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27600, rc 0) 00000100:00100000:3.0:1789448365.313766:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+41:11419:x1876372295324928:12345-192.168.202.54@tcp:101:dd.0 Request processed in 7513us (7801us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789448365.313773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:2.0:1789448365.317740:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.317819:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295325312 00000100:00100000:0.0:1789448365.317829:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295325312 00000100:00100000:0.0:1789448365.317884:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:0.0:1789448365.317894:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+41:11419:x1876372295325312:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:0.0:1789448365.318150:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.318168:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.318179:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448365.318260:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789448365.318287:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000027c167c reply state 000000009f1cb628 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448365.318296:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448365.318383:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+44:11419:x1876372295325312:12345-192.168.202.54@tcp:36:dd.0 Request processed in 489us (652us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789448365.318408:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 154 00000020:00080000:0.0:1789448365.318413:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448365.321163:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321180:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321189:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321195:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448365.321200:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321208:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321254:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448365.321258:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448365.321263:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.321270:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa223 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448365.600849:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.600951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295325440 00000100:00100000:0.0:1789448365.600961:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295325440 00000100:00100000:0.0:1789448365.601024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:0.0:1789448365.601034:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+43:11433:x1876372295325440:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:0.0:1789448365.601071:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448365.601092:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa22a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eede expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601156:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601170:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601181:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601195:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601201:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601206:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601335:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601346:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601355:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601401:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.601421:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 44 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448365.601435:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317351168:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448365.601533:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4a5f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789448365.604081:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317351168:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448365.604131:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448365.608283:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448365.608512:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295325696 00000100:00100000:0.0:1789448365.608532:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295325696 00000100:00100000:0.0:1789448365.608598:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789448365.608608:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+45:5588:x1876372295325696:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789448365.608954:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+46:5588:x1876372295325696:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 347us (681us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789448365.608961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789448365.611582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448365.611714:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295325824 00000100:00100000:3.0:1789448365.611725:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295325824 00010000:00010000:3.0:1789448365.611761:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 46 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448365.611811:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1789448365.611821:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+46:2351:x1876372295325824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448365.611834:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448365.611840:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 46 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611852:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 46 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611873:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa215 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eed7 expref: 46 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611888:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448365.611894:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611903:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611910:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.611954:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448365.612012:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+45:2351:x1876372295325824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448365.612020:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00010000:00010000:0.0:1789448365.612787:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612807:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448365.612855:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789448365.612860:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448365.612886:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612899:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612924:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612931:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612938:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612944:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448365.612948:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612955:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612966:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448365.612969:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448365.612973:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612979:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612992:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.612998:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613004:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613015:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448365.613018:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613024:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613030:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0030000) 00010000:00010000:0.0:1789448365.613033:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448365.613035:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613040:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613077:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa22a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eede expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613091:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eede expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.613097:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448365.613099:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448365.613102:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448365.613152:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+44:11433:x1876372295325440:12345-192.168.202.54@tcp:101:stat.0 Request processed in 12120us (12313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448365.613159:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:0.0:1789448365.709462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448365.709724:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295326080 00000100:00100000:2.0:1789448365.709735:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295326080 00000100:00100000:2.0:1789448365.709836:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:2.0:1789448365.709847:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+44:11439:x1876372295326080:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:2.0:1789448365.709907:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448365.709937:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa23f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eede expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.709952:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448365.709955:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448365.710134:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.710144:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448365.710151:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448365.710188:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789448365.710203:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008536cf3e reply state 00000000acc0d886 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448365.710209:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448365.710368:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+46:11439:x1876372295326080:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 522us (915us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789448365.710376:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 156 00000020:00080000:2.0:1789448365.710381:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448365.711800:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711817:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711826:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711831:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448365.711837:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711844:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711859:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448365.711862:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448365.711868:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448365.711873:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448365.918379:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000001:00080000:0.0:1789448365.918413:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:0.0:1789448365.918425:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789448365.918450:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9c85e5840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789448365.918456:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9e79bf900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9c85e5240 00000020:00080000:0.0:1789448365.918460:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9e79bf700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9fffa0800 00000100:00100000:1.0:1789448365.918660:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448365.918679:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317351296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789448365.918744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789448365.920174:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789448365.920349:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789448365.920368:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317351296 00000100:00100000:3.0:1789448365.920376:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317351296 00000100:00100000:3.0:1789448365.920422:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789448365.920431:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317351296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789448365.920459:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789448365.920492:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8d0ac, atime: 0x6aa8d0ac, ctime: 0x6aa8d0ac, blocks: 0xb 00010000:00010000:3.0:1789448365.920500:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.920524:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1789448365.920530:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448365.920536:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.920560:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.920571:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.920594:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.920610:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789448365.921111:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317351296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 678us (2364us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789448365.921120:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789448365.921146:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448365.921153:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.921162:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448365.921167:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.921176:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.921194:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.921200:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa24d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.921257:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448365.921265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448365.921266:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789448365.921312:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9f550a680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789448365.921319:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317351296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789448365.927874:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448365.928048:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295326208 00000100:00100000:3.0:1789448365.928058:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295326208 00000100:00100000:3.0:1789448365.928113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:3.0:1789448365.928124:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+15:11453:x1876372295326208:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1789448365.928149:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448365.928170:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eee5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928256:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928272:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928284:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928298:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928306:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928313:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928845:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928862:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928871:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448365.928909:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789448365.928913:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448365.928935:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928947:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928956:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928962:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928979:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928985:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448365.928989:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.928997:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929007:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448365.929016:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448365.929022:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929028:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa25b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929042:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929047:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929052:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929056:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448365.929059:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929064:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929071:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448365.929073:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448365.929076:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929080:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929111:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929137:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448365.929144:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448365.929147:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448365.929150:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27400, rc 0) 00000100:00100000:3.0:1789448365.929248:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+16:11453:x1876372295326208:12345-192.168.202.54@tcp:101:stat.0 Request processed in 1125us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448365.929256:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000001:00080000:0.0:1789448365.946657:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789448365.946689:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1789448366.078355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.078471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295326464 00000100:00100000:0.0:1789448366.078481:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295326464 00000100:00100000:0.0:1789448366.078576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:0.0:1789448366.078586:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+16:11464:x1876372295326464:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448366.078606:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448366.078626:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eeec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448366.078712:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789448366.078926:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa270 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.078941:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:0.0:1789448366.078944:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448366.078949:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eeec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.078961:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33800, rc 0) 00000100:00100000:0.0:1789448366.079037:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:11464:x1876372295326464:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 452us (693us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1789448366.079045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00080000:1.0:1789448366.080001:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448366.083351:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.083528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295326720 00000100:00100000:0.0:1789448366.083538:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295326720 00000100:00100000:0.0:1789448366.083640:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789448366.083652:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2deec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:11464:x1876372295326720:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448366.083886:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2deec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11464:x1876372295326720:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 236us (543us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789448366.083910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1789448366.178445:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448366.178762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295326976 00000100:00100000:1.0:1789448366.178773:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295326976 00000100:00100000:1.0:1789448366.178868:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:1.0:1789448366.178879:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11470:x1876372295326976:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448366.178906:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448366.178930:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fa27e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eef3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.179038:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.179068:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.179077:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.179108:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.179122:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 19 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448366.179136:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317351424:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448366.179367:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf353c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448366.182907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.183011:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317351424:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448366.183046:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448366.183121:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295327104 00000100:00100000:2.0:1789448366.183129:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295327104 00010000:00010000:2.0:1789448366.183166:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 20 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448366.183241:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:2.0:1789448366.183248:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+20:2351:x1876372295327104:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448366.183280:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448366.183288:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 20 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183300:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 20 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183324:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eee5 expref: 20 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183338:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448366.183341:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183349:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183354:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.183376:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448366.183418:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+19:2351:x1876372295327104:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 171us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448366.183423:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00010000:00010000:0.0:1789448366.183577:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.183595:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448366.183620:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789448366.183755:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fa27e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.183767:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.183772:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.183774:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789448366.183775:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34200, rc 0) 00000100:00100000:0.0:1789448366.183807:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11470:x1876372295326976:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4932us (5374us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789448366.183812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:1.0:1789448366.190631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.190862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295327360 00000100:00100000:0.0:1789448366.190873:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295327360 00000100:00100000:0.0:1789448366.190936:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:0.0:1789448366.190946:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11470:x1876372295327360:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:0.0:1789448366.191281:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.191300:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.191312:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448366.191364:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789448366.191389:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b2aa8d7 reply state 0000000036b818eb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448366.191397:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448366.191488:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11470:x1876372295327360:12345-192.168.202.54@tcp:36:bash.0 Request processed in 543us (878us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789448366.191496:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 160 00000020:00080000:0.0:1789448366.191501:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448366.199822:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199841:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199848:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199854:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448366.199858:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199865:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199897:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.199900:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448366.199905:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.199911:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa293 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448366.206704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448366.206948:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295327488 00000100:00100000:3.0:1789448366.206959:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295327488 00000100:00100000:3.0:1789448366.207177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:3.0:1789448366.207189:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11470:x1876372295327488:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789448366.207253:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448366.207277:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa29a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eefa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.207380:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.207396:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.207404:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.207451:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.207465:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 22 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448366.207478:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317351552:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448366.207577:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448366.214696:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.214823:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317351552:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448366.214855:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448366.214934:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295327616 00000100:00100000:0.0:1789448366.214942:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295327616 00010000:00010000:0.0:1789448366.214978:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 23 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448366.215018:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1789448366.215026:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+23:2351:x1876372295327616:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448366.215042:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448366.215049:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 23 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215061:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 23 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215084:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa285 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eef3 expref: 23 pid: 5833 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215099:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.215103:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215131:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215138:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.215167:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448366.215271:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+22:2351:x1876372295327616:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 244us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448366.215278:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00010000:00010000:3.0:1789448366.215752:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.215761:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448366.215810:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789448366.215814:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448366.215834:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.215866:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa29a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eefa expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.215881:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eefa expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.215889:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448366.215892:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448366.215903:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26600, rc 0) 00000100:00100000:3.0:1789448366.215950:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11470:x1876372295327488:12345-192.168.202.54@tcp:101:bash.0 Request processed in 8764us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448366.215958:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:3.0:1789448366.224099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.225350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295327872 00000100:00100000:2.0:1789448366.225377:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295327872 00000100:00100000:2.0:1789448366.225444:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1789448366.225455:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11470:x1876372295327872:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789448366.225985:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11470:x1876372295327872:12345-192.168.202.54@tcp:35:bash.0 Request processed in 518us (1883us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789448366.225996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00010000:00010000:3.0:1789448366.233743:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448366.300105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.300166:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295328128 00000100:00100000:0.0:1789448366.300177:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295328128 00000100:00100000:0.0:1789448366.300319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:0.0:1789448366.300330:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11480:x1876372295328128:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448366.300355:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448366.300377:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa2a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef01 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448366.300475:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789448366.300638:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa2a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef01 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.300651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:0.0:1789448366.300653:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448366.300657:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa2a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef01 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.300669:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448366.300730:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11480:x1876372295328128:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 403us (635us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789448366.300738:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:1.0:1789448366.303433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.303523:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295328256 00000100:00100000:0.0:1789448366.303535:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295328256 00000100:00100000:0.0:1789448366.303637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:0.0:1789448366.303649:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11480:x1876372295328256:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1789448366.303730:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.303747:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.303765:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.303781:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.303787:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.303791:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304025:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304032:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304037:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448366.304078:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304087:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304092:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304096:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304100:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448366.304103:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304107:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304115:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448366.304117:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448366.304120:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304124:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304131:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304135:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304142:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304145:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448366.304147:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304150:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304154:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0030500) 00010000:00010000:0.0:1789448366.304155:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448366.304157:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304160:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa2bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304169:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304173:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304176:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304178:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448366.304180:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304191:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304196:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.304197:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448366.304199:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.304202:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa2c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448366.304316:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11480:x1876372295328256:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 671us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448366.304322:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:0.0:1789448366.306939:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.307024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295328512 00000100:00100000:2.0:1789448366.307036:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295328512 00000100:00100000:2.0:1789448366.307091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1789448366.307100:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11480:x1876372295328512:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448366.307331:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11480:x1876372295328512:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 231us (401us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789448366.307339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1789448366.341771:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.341839:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295328768 00000100:00100000:2.0:1789448366.341849:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295328768 00000100:00100000:2.0:1789448366.341905:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:2.0:1789448366.341915:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11483:x1876372295328768:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448366.341940:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448366.341961:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa2cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef08 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342026:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342036:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342046:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342076:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342084:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342092:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342415:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa2e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342425:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342432:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448366.342442:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789448366.342534:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342542:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342549:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342555:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448366.342560:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342701:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342711:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448366.342713:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448366.342716:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342720:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa2d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342731:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342735:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342739:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342742:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448366.342743:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342746:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342750:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311000) 00010000:00010000:2.0:1789448366.342751:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448366.342753:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342762:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342796:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa2cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef08 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342805:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef08 expref: 26 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448366.342810:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:2.0:1789448366.342811:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448366.342813:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2600, rc 0) 00000100:00100000:2.0:1789448366.342868:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11483:x1876372295328768:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 954us (1106us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789448366.342875:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:0.0:1789448366.344988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.345019:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448366.345062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295329024 00000100:00100000:3.0:1789448366.345072:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295329024 00000100:00100000:3.0:1789448366.345123:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:3.0:1789448366.345133:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11483:x1876372295329024:12345-192.168.202.54@tcp:54:lfs.0 00000100:00100000:1.0:1789448366.345138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295328896 00000100:00100000:1.0:1789448366.345142:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295328896 00010000:00010000:3.0:1789448366.345205:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345242:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448366.345246:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00010000:00010000:3.0:1789448366.345255:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448366.345265:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:2351:x1876372295328896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448366.345277:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448366.345279:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345285:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345292:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345453:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448366.345463:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.345466:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa2e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef08 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345487:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.345495:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:3.0:1789448366.345499:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:1.0:1789448366.345500:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448366.345502:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448366.345506:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448366.345526:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa2ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448366.345655:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11483:x1876372295329024:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 523us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448366.345665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:1.0:1789448366.345816:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+25:2351:x1876372295328896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 562us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448366.345824:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789448366.347330:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.347444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295329280 00000100:00100000:2.0:1789448366.347452:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295329280 00000100:00100000:2.0:1789448366.347488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1789448366.347497:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+25:11483:x1876372295329280:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448366.347901:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11483:x1876372295329280:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 405us (576us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789448366.347907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789448366.453075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.453246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295329536 00000100:00100000:0.0:1789448366.453257:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295329536 00000100:00100000:0.0:1789448366.453322:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:0.0:1789448366.453333:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11501:x1876372295329536:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1789448366.453363:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448366.453386:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef0f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.453501:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa2fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.453527:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.453540:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448366.453671:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789448366.453796:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa2f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef0f expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.453827:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa2fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef0f expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.453836:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.453839:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789448366.453843:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32000, rc 0) 00000100:00100000:0.0:1789448366.453908:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11501:x1876372295329536:12345-192.168.202.54@tcp:101:cat.0 Request processed in 577us (842us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789448366.453915:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:0.0:1789448366.482832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448366.482951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295329664 00000100:00100000:1.0:1789448366.482962:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295329664 00000100:00100000:1.0:1789448366.483038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:1.0:1789448366.483048:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11502:x1876372295329664:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448366.483071:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448366.483092:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa30a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef16 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483154:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483168:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483179:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448366.483212:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789448366.483239:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448366.483259:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483286:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa30a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef16 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483321:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef16 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.483330:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448366.483333:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448366.483337:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34a00, rc 0) 00000100:00100000:1.0:1789448366.483400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11502:x1876372295329664:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 353us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448366.483407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:3.0:1789448366.491132:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448366.491305:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330048 00000100:00100000:2.0:1789448366.491316:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330048 00000100:00100000:2.0:1789448366.491376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1789448366.491388:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11502:x1876372295330048:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448366.492373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11502:x1876372295330048:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 983us (1249us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789448366.492383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789448366.495201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.495346:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330176 00000100:00100000:0.0:1789448366.495357:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330176 00000100:00100000:0.0:1789448366.495477:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1789448366.495488:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11502:x1876372295330176:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:0.0:1789448366.495531:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789448366.495565:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa2a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eefa expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.495590:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa2fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef0f expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.495602:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa1a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eebb expref: 28 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.495868:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311200) 00010000:00010000:0.0:1789448366.495881:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448366.495935:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11502:x1876372295330176:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 448us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448366.495943:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448366.498977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448366.499345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330304 00000100:00100000:0.0:1789448366.499357:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330304 00000100:00100000:0.0:1789448366.499467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:0.0:1789448366.499487:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11502:x1876372295330304:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:0.0:1789448366.499627:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.499644:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448366.499656:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448366.500258:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789448366.500358:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11502:x1876372295330304:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 881us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448366.500367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:3.0:1789448366.526973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448366.527142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330432 00000100:00100000:1.0:1789448366.527154:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330432 00000100:00100000:1.0:1789448366.527246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:1.0:1789448366.527257:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11504:x1876372295330432:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448366.527280:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448366.527302:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fa31f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef1d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527372:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527386:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527397:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527427:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527434:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527440:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527782:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527790:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448366.527829:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789448366.527833:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448366.527852:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527864:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527872:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527879:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527902:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448366.527905:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527912:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527923:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448366.527926:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448366.527930:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527948:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527954:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527966:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448366.527969:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.527984:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.528006:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9e0bd6100) 00010000:00010000:1.0:1789448366.528009:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448366.528012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.528017:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35a00/0xe29566c2465fa32d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.528051:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fa31f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.528063:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448366.528070:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:1.0:1789448366.528073:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448366.528075:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448366.528150:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11504:x1876372295330432:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 894us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448366.528158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000040:00080000:2.0:1789448367.009469:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789448367.009479:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789448367.009542:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789448367.009550:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789448367.009674:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf16300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317351680:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789448367.009778:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c11caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448367.037600:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.037638:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330560 00000100:00100000:1.0:1789448367.037646:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330560 00000100:00100000:1.0:1789448367.037693:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:1.0:1789448367.037702:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295330560:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789448367.037743:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789448367.037831:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295330560:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.037838:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:3.0:1789448367.041787:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf16300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317351680:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789448367.046914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.046949:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330688 00000100:00100000:3.0:1789448367.046958:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330688 00000100:00100000:3.0:1789448367.047008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:3.0:1789448367.047019:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11515:x1876372295330688:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.047089:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047107:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047118:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047153:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047159:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047195:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047200:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448367.047260:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789448367.047264:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448367.047278:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047290:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047296:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047302:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047317:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.047321:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047328:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.047338:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:3.0:1789448367.047341:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.050808:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050819:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa33b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050837:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050843:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050850:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050856:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.050861:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050868:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448367.050910:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.050914:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050920:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa342 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050942:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050949:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050955:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050960:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.050963:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050969:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050976:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:3.0:1789448367.050979:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.050982:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.050987:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.051104:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11515:x1876372295330688:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 4081us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.051115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:1.0:1789448367.058139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.058349:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295330944 00000100:00100000:2.0:1789448367.058360:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295330944 00000100:00100000:2.0:1789448367.058412:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:2.0:1789448367.058423:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11515:x1876372295330944:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448367.058444:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448367.058465:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa350 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef24 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058614:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058631:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058644:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448367.058655:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789448367.058749:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058763:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058768:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058774:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448367.058778:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058784:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058795:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:2.0:1789448367.058798:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448367.058803:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058809:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058845:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa350 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef24 expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058854:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:2.0:1789448367.058856:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448367.058860:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa350 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef24 expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.058870:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448367.058938:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295330944:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 516us (808us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789448367.058944:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:1.0:1789448367.076126:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.076242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295331072 00000100:00100000:3.0:1789448367.076252:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295331072 00000100:00100000:3.0:1789448367.076310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1789448367.076320:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295331072:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789448367.076360:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789448367.076460:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295331072:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 140us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.076467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:0.0:1789448367.087483:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.087573:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295331328 00000100:00100000:1.0:1789448367.087583:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295331328 00000100:00100000:1.0:1789448367.087675:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:1.0:1789448367.087685:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295331328:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448367.087706:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448367.087710:0:7825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789448367.087736:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef16 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.087756:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448367.087760:0:7825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448367.087773:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa365 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef2b expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448367.088471:0:7825:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789448367.088737:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa36c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.088752:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa36c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.088763:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa36c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.088822:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa365 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef2b expref: 31 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.088838:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa36c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef2b expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.088846:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6100) 00010000:00010000:1.0:1789448367.088849:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448367.088851:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35e00, rc 0) 00000100:00100000:1.0:1789448367.088913:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11515:x1876372295331328:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1229us (1438us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789448367.088921:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:2.0:1789448367.106166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.106612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295331584 00000100:00100000:3.0:1789448367.106623:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295331584 00000100:00100000:3.0:1789448367.106690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:3.0:1789448367.106701:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11515:x1876372295331584:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.106769:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448367.106800:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa36c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef2b expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.106819:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6100) 00010000:00010000:3.0:1789448367.106830:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448367.106852:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.108744:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.108771:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.108792:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.108800:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.108807:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109008:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109016:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109022:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109028:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.109032:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109040:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109050:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448367.109053:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.109057:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa37a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109079:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109085:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109090:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109095:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.109098:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109103:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109111:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe1db9ec1 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448367.109114:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.109117:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.109123:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa381 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe1db9ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.109241:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295331584:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2519us (3065us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448367.109250:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:0.0:1789448367.111928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.112001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295331712 00000100:00100000:1.0:1789448367.112010:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295331712 00000100:00100000:1.0:1789448367.112099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:1.0:1789448367.112109:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11515:x1876372295331712:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448367.112129:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448367.112151:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa388 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112186:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112199:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112211:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112341:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112372:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.112380:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:1.0:1789448367.112383:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789448367.112387:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34a00, rc 0) 00000100:00100000:1.0:1789448367.112442:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11515:x1876372295331712:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 335us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.112448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:0.0:1789448367.117099:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.117173:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295331968 00000100:00100000:1.0:1789448367.117183:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295331968 00000100:00100000:1.0:1789448367.117262:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:1.0:1789448367.117272:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+30:11515:x1876372295331968:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448367.117465:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.117482:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.117494:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448367.117882:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789448367.117892:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388820674390ns, next at 389820672332ns, rc = 0 00000004:00010000:1.0:1789448367.118617:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000366ba8d8 reply state 0000000067147dbb transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448367.118628:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448367.118766:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11515:x1876372295331968:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1492us (1676us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789448367.118774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 177 00010000:00010000:1.0:1789448367.120860:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120877:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120884:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120890:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448367.120895:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120903:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120918:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:1.0:1789448367.120921:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789448367.120927:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.120933:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa396 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448367.123106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.123176:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332096 00000100:00100000:3.0:1789448367.123186:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332096 00000100:00100000:3.0:1789448367.123394:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:3.0:1789448367.123405:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+31:11515:x1876372295332096:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.123433:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448367.123453:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef39 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.123518:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 32 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.123541:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 32 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.123562:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:3.0:1789448367.123565:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448367.123569:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448367.123619:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11515:x1876372295332096:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 216us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.123626:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:0.0:1789448367.128139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.128210:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332224 00000100:00100000:2.0:1789448367.128336:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332224 00000100:00080000:0.0:1789448367.128522:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448367.128560:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1789448367.128572:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295332224:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789448367.128902:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295332224:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 332us (772us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789448367.128911:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1789448367.135779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.135878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332480 00000100:00100000:2.0:1789448367.135888:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332480 00000100:00100000:2.0:1789448367.135943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789448367.135954:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11515:x1876372295332480:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789448367.136550:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11515:x1876372295332480:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 596us (779us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789448367.136559:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789448367.140182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.140282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332736 00000100:00100000:3.0:1789448367.140292:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332736 00000100:00100000:3.0:1789448367.140378:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:3.0:1789448367.140389:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11515:x1876372295332736:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789448367.140516:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11515:x1876372295332736:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.140524:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:0.0:1789448367.143811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.143891:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332864 00000100:00100000:1.0:1789448367.143915:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332864 00000100:00100000:1.0:1789448367.143981:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:1.0:1789448367.143991:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+33:11515:x1876372295332864:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448367.144009:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448367.144029:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144117:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144131:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144143:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448367.144188:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448367.144207:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144620:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef40 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144637:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef40 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.144646:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:1.0:1789448367.144649:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789448367.144652:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34e00, rc 0) 00000100:00100000:1.0:1789448367.144743:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11515:x1876372295332864:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 753us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.144757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:1.0:1789448367.148855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.148942:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295332992 00000100:00100000:3.0:1789448367.148953:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295332992 00000100:00100000:3.0:1789448367.149143:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789448367.149153:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295332992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.149180:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448367.149201:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef47 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448367.149336:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d0af, blocks: 0x1 00010000:00010000:3.0:1789448367.149426:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1789448367.149431:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448367.149441:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.149461:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.149473:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448367.149621:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295332992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 469us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.149628:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:0.0:1789448367.153632:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.153700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333248 00000100:00100000:1.0:1789448367.153708:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333248 00000100:00100000:1.0:1789448367.153777:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:1.0:1789448367.153785:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11515:x1876372295333248:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789448367.153885:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11515:x1876372295333248:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.153893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:2.0:1789448367.156539:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.156610:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333376 00000100:00100000:3.0:1789448367.156620:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333376 00000100:00100000:3.0:1789448367.156672:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:3.0:1789448367.156683:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:11515:x1876372295333376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.156701:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448367.156744:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef4e expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.156776:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.156785:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448367.156789:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448367.156794:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.156827:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.156840:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 9 pid: 6673 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.156853:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317351808:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448367.156932:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1789448367.159520:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.159585:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333504 00000100:00100000:2.0:1789448367.159591:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333504 00010000:00010000:2.0:1789448367.159630:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 10 pid: 6673 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.159660:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1789448367.159666:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2350:x1876372295333504:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448367.159690:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448367.159708:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 10 pid: 6673 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.159718:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 10 pid: 6673 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.159737:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448367.159740:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448367.159746:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.159752:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.159783:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.159797:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1876372317351936:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789448367.159877:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4eae840 going to sleep for 11 seconds 00010000:00010000:3.0:1789448367.160317:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eac430b/0xe29566c2465fa3b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef47 expref: 10 pid: 6673 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.160331:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317351808:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448367.160402:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.160421:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27600, rc 0) 00000100:00100000:3.0:1789448367.160454:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:11515:x1876372295333376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3775us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.160460:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789448367.164319:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.164356:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333632 00000100:00100000:3.0:1789448367.164366:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333632 00002000:00100000:3.0:1789448367.164414:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97d9fb0b1f80 x1876372295333632/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:228/0 lens 504/0 e 0 to 0 dl 1789448378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448367.164426:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fb0b1f80 with x1876372295333632 ext(0->8) 00002000:00010000:3.0:1789448367.164431:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fb0b1f80 00000100:00100000:3.0:1789448367.164463:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789448367.164472:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295333632:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789448367.164473:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1876372317351936:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789448367.164494:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448367.164643:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295333504:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4975us (5142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.164653:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1789448367.164946:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2350:x1876372295333632:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 474us (633us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789448367.164954:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00002000:00100000:3.0:1789448367.164973:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97d9fb0b1f80 x1876372295333632/t4294967314(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:228/0 lens 504/448 e 0 to 0 dl 1789448378 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448367.164982:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fb0b1f80 with x1876372295333632 ext(0->8) 00002000:00010000:3.0:1789448367.164986:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fb0b1f80 00000100:00100000:0.0:1789448367.167522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.167634:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333760 00000100:00100000:3.0:1789448367.167642:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333760 00000100:00100000:3.0:1789448367.167684:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:3.0:1789448367.167695:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11515:x1876372295333760:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789448367.198331:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:3.0:1789448367.198368:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789448367.198373:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789448367.198388:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1789448367.198410:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789448367.198547:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789448367.198558:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789448367.198577:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317352064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789448367.198646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448367.198700:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317352064 00000100:00100000:3.0:1789448367.198707:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317352064 00000100:00100000:3.0:1789448367.198756:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789448367.198765:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317352064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789448367.198909:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789448367.198913:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789448367 00002000:00010000:3.0:1789448367.198915:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789448367.198918:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789448367 -> 1789448367 00002000:00010000:3.0:1789448367.198920:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789448367.198959:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317352064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (313us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789448367.198966:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789448367.198985:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789448367.199015:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9fffafb80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789448367.199020:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317352064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789448367.200541:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11515:x1876372295333760:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 32839us (33027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.200553:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:1.0:1789448367.207436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.207529:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295333888 00000100:00100000:2.0:1789448367.207540:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295333888 00000100:00100000:2.0:1789448367.207598:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:2.0:1789448367.207609:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2351:x1876372295333888:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789448367.258538:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789448367.268671:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789448367.268689:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1789448367.268695:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789448367.269728:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295333888:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 62112us (62290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448367.269741:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:2.0:1789448367.276004:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.276076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334144 00000100:00100000:3.0:1789448367.276087:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334144 00000100:00100000:3.0:1789448367.276532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 183 00000100:00100000:3.0:1789448367.276560:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11515:x1876372295334144:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789448367.276613:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448367.276641:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa3ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef40 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.276657:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:3.0:1789448367.276662:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448367.276692:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.276706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.276716:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789448367.276963:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc9a823e reply state 00000000bfe1bbdf transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.276973:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789448367.277063:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11515:x1876372295334144:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 505us (1067us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789448367.277071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 183 00010000:00010000:3.0:1789448367.279526:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279551:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279558:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279571:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.279576:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279585:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279601:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:3.0:1789448367.279604:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.279608:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.279614:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.280422:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.280451:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334272 00000100:00100000:3.0:1789448367.280460:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334272 00000100:00100000:3.0:1789448367.280499:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1789448367.280518:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295334272:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789448367.280742:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789448367.280746:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789448367 -> 1789448366 00002000:00010000:3.0:1789448367.280749:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789448364 00002000:00010000:3.0:1789448367.280751:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789448367 -> 1789448366 00002000:00010000:3.0:1789448367.280753:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789448367.280799:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295334272:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 292us (382us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789448367.280806:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1789448367.295815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.297183:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334528 00000100:00100000:1.0:1789448367.297196:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334528 00000100:00100000:1.0:1789448367.297274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:1.0:1789448367.297285:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11515:x1876372295334528:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789448367.297357:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.297374:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.297383:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.297419:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.297433:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 18 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448367.297454:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317352192:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448367.297554:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448367.302962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.303057:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876372317352192:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448367.303091:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.305640:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334656 00000100:00100000:2.0:1789448367.305652:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334656 00010000:00010000:2.0:1789448367.305691:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 19 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.305727:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1789448367.305736:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:2351:x1876372295334656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448367.305750:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448367.305756:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 19 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305767:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 19 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305790:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa38f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef32 expref: 19 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305810:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:2.0:1789448367.305816:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305826:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305833:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.305868:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448367.305927:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+18:2351:x1876372295334656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 191us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.305935:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00010000:00010000:1.0:1789448367.306540:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306551:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306579:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306587:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306593:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306598:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448367.306602:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306610:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306620:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:1.0:1789448367.306628:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789448367.306633:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.306639:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448367.306683:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+17:11515:x1876372295334528:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 9400us (10877us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789448367.306691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:3.0:1789448367.313442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.313500:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334784 00000100:00100000:2.0:1789448367.313521:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334784 00000100:00100000:2.0:1789448367.313591:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1789448367.313602:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295334784:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789448367.313646:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.313667:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.313676:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789448367.313681:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448367.313686:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.313736:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.313751:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 8 pid: 6671 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.313767:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4feea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317352320:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448367.313849:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f4eae900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448367.327792:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4feea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317352320:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448367.327826:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.328647:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.328734:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295334912 00000100:00100000:2.0:1789448367.328743:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295334912 00010000:00010000:2.0:1789448367.328782:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.328824:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:2.0:1789448367.328834:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295334912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448367.328847:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448367.328871:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.328884:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.328906:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006409ae69/0xe29566c2465fa3b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef4e expref: 9 pid: 6671 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.328937:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448367.328941:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448367.328946:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.328956:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.328987:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448367.329034:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295334912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 201us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.329040:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00010000:00010000:3.0:1789448367.329527:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329546:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329570:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329588:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329596:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329603:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448367.329607:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329630:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329643:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.329652:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eda2209a/0xe29566c2465fa3ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.329699:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295334784:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 16099us (16266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.329706:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000040:00080000:3.0:1789448367.339385:0:12445:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448367.339396:0:12445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448367.339456:0:12445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789448367.339462:0:12445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789448367.340640:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.342258:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295335168 00000100:00100000:2.0:1789448367.342273:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295335168 00000100:00100000:2.0:1789448367.342331:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:2.0:1789448367.342341:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+17:11515:x1876372295335168:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789448367.342423:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342440:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342450:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342668:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342690:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 18 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342699:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342732:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 18 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.342752:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 18 pid: 7825 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.342768:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317352448:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448367.342861:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c5454900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448367.356656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448367.356787:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295335296 00000100:00100000:2.0:1789448367.356796:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295335296 00010000:00010000:2.0:1789448367.356839:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 19 pid: 7825 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.356878:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789448367.356888:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:2350:x1876372295335296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448367.356901:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448367.356908:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 19 pid: 7825 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.356940:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 19 pid: 7825 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.356963:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:2.0:1789448367.356985:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.356994:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.357002:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448367.357021:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448367.357077:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:2350:x1876372295335296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 190us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.357085:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00010000:00010000:0.0:1789448367.358886:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa39d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef39 expref: 18 pid: 7825 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448367.358907:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317352448:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448367.358929:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.366008:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.366026:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448367.367689:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1789448367.367906:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789448367.367948:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1789448367.368035:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317352576:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448367.368100:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448367.368138:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35000 going to sleep for 11 seconds 00000100:00100000:0.0:1789448367.368354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317352576 00000100:00100000:0.0:1789448367.368362:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317352576 00000100:00100000:0.0:1789448367.368416:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448367.368425:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317352576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789448367.368501:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317352576:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448367.368519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448367.368749:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789448367.368754:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9fffafb80, transno 4294967315 00000100:00100000:1.0:1789448367.368806:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317352576:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789448367.369256:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789448367.369317:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317352704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448367.369351:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448367.369375:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf353c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448367.372696:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317352704 00000100:00100000:1.0:1789448367.372712:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317352704 00000100:00100000:1.0:1789448367.372771:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448367.372782:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876372317352704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448367.373072:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876372317352704:12345-0@lo:1000:mdt00_002.0 Request processed in 292us (3719us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789448367.373080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448367.373133:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317352704:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789448367.373174:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373185:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373193:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373200:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448367.373204:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373212:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373244:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:1.0:1789448367.373247:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448367.373252:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373258:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa3dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373304:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373310:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373316:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373321:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448367.373324:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373329:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373337:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:1.0:1789448367.373339:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448367.373342:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373348:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa318 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373368:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373383:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373392:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373436:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.373450:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 21 pid: 5833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448367.373465:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317352832:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448367.373553:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c8318240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448367.389416:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317352832:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448367.389450:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448367.393269:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448367.393399:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295335424 00000100:00100000:3.0:1789448367.393413:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295335424 00010000:00010000:3.0:1789448367.393457:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 22 pid: 5833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448367.393514:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:3.0:1789448367.393545:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+22:2351:x1876372295335424:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448367.393560:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448367.393569:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 22 pid: 5833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393584:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 22 pid: 5833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393607:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef1d expref: 22 pid: 5833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393624:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:3.0:1789448367.393630:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393641:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393649:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393675:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448367.393730:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:2351:x1876372295335424:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 189us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448367.393738:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00010000:00010000:3.0:1789448367.393828:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393835:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393855:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393862:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393868:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393873:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.393877:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393885:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393892:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:3.0:1789448367.393895:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448367.393898:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393904:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa3e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393912:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393917:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393922:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393933:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448367.393937:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393942:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393949:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0030500) 00010000:00010000:3.0:1789448367.393951:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448367.393954:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.393972:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa3d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448367.394275:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448367.394280:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448367.394748:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789448367.394758:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448367.394842:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11515:x1876372295335168:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 52500us (54206us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789448367.394852:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00000020:00080000:3.0:1789448367.394856:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789448367.410383:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448367.410460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295335680 00000100:00100000:1.0:1789448367.410471:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295335680 00000100:00100000:1.0:1789448367.410548:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1789448367.410558:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2dee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11515:x1876372295335680:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789448367.411289:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789448367.411396:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789448367.411449:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411467:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411479:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411488:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411494:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411523:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448367.411548:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789448367.411643:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2dee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11515:x1876372295335680:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1085us (1269us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789448367.411651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000020:00080000:1.0:1789448367.411656:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789448367.412367:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448367.412377:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.412386:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448367.412391:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.412411:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.412424:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97d9e0bd6f00) 00010000:00010000:3.0:1789448367.412427:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789448367.412432:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.412437:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa3ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448367.412460:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448367.412461:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448367.412463:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448367.897553:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317353344:0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.897553:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317352960:0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.897624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448367.897673:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317353472:0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.897700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448367.897701:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317353088:0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.897729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448367.897751:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317352960 00000100:00100000:2.0:1789448367.897760:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317352960 00000100:00100000:1.0:1789448367.897771:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353472 00000100:00100000:1.0:1789448367.897774:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353472 00000100:00100000:2.0:1789448367.897802:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789448367.897810:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3304:x1876372317352960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.897822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353088 00000100:00100000:1.0:1789448367.897825:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353088 00000100:00100000:1.0:1789448367.897843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789448367.897849:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317353472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.897885:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3304:x1876372317352960:12345-0@lo:400:kworker.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.897891:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876372317353472:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.897892:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789448367.897896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789448367.897908:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789448367.897913:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.897935:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317352960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.897942:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317353088:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.897947:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317353472:0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.897947:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789448367.897970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317353088:0@lo:400:kworker.0 00000100:00080000:2.0:1789448367.897991:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448367.898111:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317353216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448367.898153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448367.898334:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448367.898389:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353344 00000100:00100000:2.0:1789448367.898394:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353344 00000100:00100000:2.0:1789448367.898438:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789448367.898446:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317353344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448367.898482:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317353344:12345-0@lo:400:kworker.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448367.898488:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1789448367.899287:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448367.899311:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789448367.899315:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789448367.899333:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97d9f550a680 x1876372317351296/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789448381 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448367.899341:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317353344:0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.899450:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353216 00000100:00100000:1.0:1789448367.899466:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353216 00000100:00100000:1.0:1789448367.899513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789448367.899530:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317353216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448367.899595:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317353216:12345-0@lo:400:kworker.0 Request processed in 75us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448367.899602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789448367.899619:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317353216:0@lo:400:kworker.0 00000100:00080000:3.0:1789448367.899653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448368.282064:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448368.409609:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317353600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448368.409684:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448368.409967:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353600 00000100:00100000:2.0:1789448368.409976:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353600 00000100:00100000:2.0:1789448368.410034:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789448368.410044:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317353600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448368.410257:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448368.410318:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317353600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 275us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448368.410326:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448368.410417:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317353600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448368.923273:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317353728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448368.923346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448368.923420:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317353728 00000100:00100000:2.0:1789448368.923429:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317353728 00000100:00100000:2.0:1789448368.923502:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789448368.923513:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317353728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448368.923548:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448368.923593:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876372317353728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448368.923601:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789448368.923653:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317353728:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789448369.051842:0:12496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789448369.051852:0:12496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448369.051900:0:12496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789448369.051905:0:12496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789448369.164155:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.164344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295335936 00000100:00100000:3.0:1789448369.164354:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295335936 00000100:00100000:3.0:1789448369.164428:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:3.0:1789448369.164440:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+22:11533:x1876372295335936:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448369.164477:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448369.164510:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa3f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef55 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.164616:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.164630:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.164642:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448369.164653:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000100:00080000:2.0:1789448369.164827:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789448369.164953:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa3f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef55 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.164971:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef55 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.164981:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448369.164984:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789448369.164987:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448369.165058:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11533:x1876372295335936:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 619us (912us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789448369.165066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:3.0:1789448369.169839:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448369.172711:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295336064 00000100:00100000:1.0:1789448369.172727:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295336064 00000100:00100000:1.0:1789448369.172786:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00100000:1.0:1789448369.172798:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11533:x1876372295336064:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1789448369.172879:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.172896:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.172909:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.172925:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.172944:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.172951:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173193:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173202:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173208:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448369.173267:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173280:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173287:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173293:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173299:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448369.173303:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173310:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173327:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448369.173330:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448369.173336:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173341:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173352:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173357:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173362:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173367:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448369.173369:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173375:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173383:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9e0bd6b00) 00010000:00010000:1.0:1789448369.173385:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448369.173389:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173395:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa40d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173420:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173427:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173433:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173437:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448369.173440:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173446:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173453:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9e0bd6700) 00010000:00010000:1.0:1789448369.173455:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448369.173457:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.173462:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.173565:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11533:x1876372295336064:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 769us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448369.173574:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00100000:2.0:1789448369.244533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.244624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295336320 00000100:00100000:3.0:1789448369.244633:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295336320 00000100:00100000:3.0:1789448369.244720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:3.0:1789448369.244732:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+24:11536:x1876372295336320:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448369.244753:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448369.244774:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa41b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef5c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244863:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244879:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244891:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244905:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244912:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.244919:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.248960:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.248979:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.248991:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448369.249016:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789448369.249283:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249292:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249298:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249305:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448369.249308:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249315:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249327:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448369.249331:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448369.249336:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249342:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249354:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249361:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249379:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249384:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448369.249387:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249394:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249402:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448369.249405:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448369.249408:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249414:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249478:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa41b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249509:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.249517:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:3.0:1789448369.249520:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448369.249522:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26400, rc 0) 00000100:00100000:3.0:1789448369.249613:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11536:x1876372295336320:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 4881us (5088us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789448369.249631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:1.0:1789448369.253473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.253584:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295336448 00000100:00100000:2.0:1789448369.253594:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295336448 00000100:00100000:2.0:1789448369.253657:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:2.0:1789448369.253668:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11536:x1876372295336448:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789448369.253801:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253818:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253830:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253856:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253863:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253870:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253889:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.253893:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253901:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253914:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:2.0:1789448369.253917:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448369.253923:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.253929:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa43e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.254014:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11536:x1876372295336448:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 347us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448369.254022:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:1.0:1789448369.266478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448369.266530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295336704 00000100:00100000:1.0:1789448369.266545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295336704 00000100:00100000:1.0:1789448369.266792:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789448369.266806:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11536:x1876372295336704:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789448369.267118:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11536:x1876372295336704:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 315us (647us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789448369.267127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00010000:00010000:0.0:1789448369.305340:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448369.329311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448369.329404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295336960 00000100:00100000:0.0:1789448369.329417:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295336960 00000100:00100000:0.0:1789448369.329495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:0.0:1789448369.329508:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11062:x1876372295336960:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448369.329544:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448369.329570:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa445 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef63 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.329699:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.329715:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.329725:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.329774:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.329789:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 28 pid: 5835 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448369.329803:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317353856:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448369.329896:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368900 going to sleep for 11 seconds 00000100:00100000:1.0:1789448369.335099:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.335390:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337088 00000100:00100000:2.0:1789448369.335400:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337088 00010000:00010000:2.0:1789448369.335442:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 29 pid: 5835 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.335505:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:2.0:1789448369.335516:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:2348:x1876372295337088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448369.335531:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448369.335539:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 29 pid: 5835 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.335568:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 29 pid: 5835 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.335591:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:2.0:1789448369.335597:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.335606:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.335613:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.335632:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448369.335691:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:2348:x1876372295337088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 177us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448369.335698:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00010000:00010000:0.0:1789448369.335865:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26400/0xe29566c2465fa430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef5c expref: 28 pid: 5835 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448369.335884:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317353856:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448369.335904:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.335915:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.335922:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448369.335954:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789448369.336190:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa445 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.336207:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.336291:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:0.0:1789448369.336295:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789448369.336298:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33200, rc 0) 00000100:00100000:0.0:1789448369.336330:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11062:x1876372295336960:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6826us (7033us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789448369.336338:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:3.0:1789448369.340946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448369.341151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337344 00000100:00100000:1.0:1789448369.341163:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337344 00000100:00100000:1.0:1789448369.341254:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:1.0:1789448369.341265:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11062:x1876372295337344:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:1.0:1789448369.343470:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.343503:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.343517:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448369.343575:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789448369.343603:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9cbebd reply state 000000006b087b94 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.343612:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789448369.343663:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789448369.343796:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11062:x1876372295337344:12345-192.168.202.54@tcp:36:bash.0 Request processed in 2529us (2855us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789448369.343806:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00000020:00080000:1.0:1789448369.343827:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789448369.347991:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1789448369.347992:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348009:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348018:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348026:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448369.348032:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348053:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348072:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:0.0:1789448369.348076:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448369.348083:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.348090:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa45a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448369.353917:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337472 00000100:00100000:3.0:1789448369.353933:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337472 00000100:00100000:3.0:1789448369.354002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:3.0:1789448369.354013:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+31:11062:x1876372295337472:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789448369.354048:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448369.354073:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef6a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.354134:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef6a expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.354152:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef6a expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.354173:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:3.0:1789448369.354176:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448369.354180:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27c00, rc 0) 00000100:00100000:3.0:1789448369.354287:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11062:x1876372295337472:12345-192.168.202.54@tcp:101:bash.0 Request processed in 274us (6305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448369.354294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:2.0:1789448369.369313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448369.369498:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337600 00000100:00100000:1.0:1789448369.369509:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337600 00000100:00100000:1.0:1789448369.369594:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:1.0:1789448369.369605:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:11062:x1876372295337600:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448369.369624:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448369.369646:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef71 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448369.369678:0:10266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8d0ae, atime: 0x6aa8d0ac, ctime: 0x6aa8d0ae, blocks: 0xb 00010000:00010000:1.0:1789448369.369702:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1789448369.369707:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448369.369715:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 8 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.369732:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 8 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.369745:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35200, rc 0) 00000100:00100000:1.0:1789448369.369813:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+8:11062:x1876372295337600:12345-192.168.202.54@tcp:101:bash.0 Request processed in 210us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448369.369820:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00080000:2.0:1789448369.369981:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448369.381251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.381315:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337728 00000100:00100000:3.0:1789448369.381371:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337728 00002000:00010000:2.0:1789448369.381510:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789448369.381516:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fac78e00 with x1876372295337728 ext(0->18446744073709551615) 00002000:00010000:2.0:1789448369.381538:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fac78e00. 00000100:00100000:2.0:1789448369.381576:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448369.381587:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295337728:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:2.0:1789448369.382203:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789448369.382208:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789448366 -> 1789448369 00002000:00010000:2.0:1789448369.382248:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789448364 -> 1789448364 00002000:00010000:2.0:1789448369.382250:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789448366 -> 1789448369 00002000:00010000:2.0:1789448369.382253:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789448369.382321:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295337728:12345-192.168.202.54@tcp:10:bash.0 Request processed in 734us (1116us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789448369.382330:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00002000:00010000:2.0:1789448369.382334:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789448369.382337:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fac78e00 with x1876372295337728 ext(0->18446744073709551615) 00002000:00010000:2.0:1789448369.382343:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fac78e00. 00000040:00080000:3.0:1789448369.433482:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448369.433526:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448369.433726:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789448369.433745:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789448369.496594:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.496709:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295337856 00000100:00100000:2.0:1789448369.496730:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295337856 00000100:00100000:2.0:1789448369.496792:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:2.0:1789448369.496804:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11550:x1876372295337856:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789448369.496880:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.496897:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.496908:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.496924:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.496931:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.496938:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497613:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497625:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497632:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448369.497671:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497695:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497702:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497709:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497715:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.497720:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497726:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497736:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448369.497740:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.497744:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497757:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa46f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497769:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497775:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497779:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497784:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.497786:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497791:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497798:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311a00) 00010000:00010000:2.0:1789448369.497800:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.497802:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497808:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497824:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497829:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497840:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497845:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.497848:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497854:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497862:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:2.0:1789448369.497865:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.497868:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.497874:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa47d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.498065:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11550:x1876372295337856:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1262us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448369.498074:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:1.0:1789448369.564532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.564791:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295338112 00000100:00100000:3.0:1789448369.564802:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295338112 00000100:00100000:3.0:1789448369.564866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:3.0:1789448369.564877:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+32:11553:x1876372295338112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448369.564898:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448369.564920:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef78 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565008:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565024:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565036:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565054:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565062:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565069:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565405:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565416:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565436:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448369.565448:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789448369.565563:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565572:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565579:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565585:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448369.565589:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565597:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565608:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448369.565612:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448369.565617:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565624:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa48b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565636:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565642:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565656:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565662:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448369.565665:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.565673:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.568243:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0a5c200) 00010000:00010000:3.0:1789448369.568252:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448369.568259:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.568269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.568341:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef78 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.568357:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef78 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.568365:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:3.0:1789448369.568368:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789448369.568371:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26600, rc 0) 00000100:00100000:3.0:1789448369.568458:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11553:x1876372295338112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 3581us (3971us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789448369.568494:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:0.0:1789448369.576946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.577052:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295338240 00000100:00100000:2.0:1789448369.577061:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295338240 00000100:00100000:2.0:1789448369.577118:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:2.0:1789448369.577127:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11553:x1876372295338240:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789448369.577205:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.577257:0:7825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.577283:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.577319:0:7825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.577334:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 34 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.577348:0:7825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317353984:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448369.577433:0:7825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448369.589214:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.589331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295338496 00000100:00100000:3.0:1789448369.589340:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295338496 00000100:00100000:3.0:1789448369.589398:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789448369.589408:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:5588:x1876372295338496:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789448369.589756:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+36:5588:x1876372295338496:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 348us (552us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789448369.589764:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1789448369.591848:0:7825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317353984:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448369.591880:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.592389:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.592473:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295338624 00000100:00100000:3.0:1789448369.592493:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295338624 00010000:00010000:3.0:1789448369.592540:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 36 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448369.592579:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1789448369.592590:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+36:2350:x1876372295338624:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448369.592606:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448369.592614:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 36 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592626:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 36 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592649:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa44c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef63 expref: 36 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592665:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:3.0:1789448369.592804:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592816:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592825:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.592861:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448369.592920:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:2350:x1876372295338624:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 332us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448369.592928:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00010000:00010000:1.0:1789448369.593058:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593073:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593106:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593113:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593120:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593127:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448369.593132:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593139:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593148:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:1.0:1789448369.593150:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448369.593155:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448369.593161:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.593204:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11553:x1876372295338240:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 16077us (16276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448369.593212:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:1.0:1789448369.599721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.599881:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295338880 00000100:00100000:3.0:1789448369.599893:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295338880 00000100:00100000:3.0:1789448369.599956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:3.0:1789448369.599967:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+34:11553:x1876372295338880:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789448369.600205:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11553:x1876372295338880:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 238us (495us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789448369.600214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789448369.688053:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.688166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295339136 00000100:00100000:2.0:1789448369.688178:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295339136 00000100:00100000:2.0:1789448369.688266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:2.0:1789448369.688277:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+35:11564:x1876372295339136:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789448369.688301:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448369.688323:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef7f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688390:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688402:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688426:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688437:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688441:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688445:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688774:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa4c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688783:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688790:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448369.688801:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789448369.688886:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688891:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688895:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688899:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.688907:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688912:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688922:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448369.688924:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.688928:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688932:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688942:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688947:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688953:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688957:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.688960:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688965:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688972:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311a00) 00010000:00010000:2.0:1789448369.688974:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.688982:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.688989:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.689029:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef7f expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.689038:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef7f expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.689043:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:2.0:1789448369.689044:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448369.689046:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2a00, rc 0) 00000100:00100000:2.0:1789448369.689157:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+37:11564:x1876372295339136:12345-192.168.202.54@tcp:101:cat.0 Request processed in 883us (1120us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789448369.689163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:1.0:1789448369.698990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.699081:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295339392 00000100:00100000:3.0:1789448369.699091:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295339392 00000100:00100000:3.0:1789448369.699149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:3.0:1789448369.699160:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+37:11564:x1876372295339392:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1789448369.699427:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11564:x1876372295339392:12345-192.168.202.54@tcp:35:cat.0 Request processed in 268us (447us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789448369.699434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1789448369.717673:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.717992:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295339648 00000100:00100000:3.0:1789448369.718013:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295339648 00000100:00100000:3.0:1789448369.718061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 197 00000100:00100000:3.0:1789448369.718071:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11565:x1876372295339648:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1789448369.718123:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789448369.718150:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa4c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef7f expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.718172:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef78 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.718185:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef6a expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.718192:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d0a5cd00) 00010000:00010000:3.0:1789448369.718202:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448369.718412:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718424:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718432:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718447:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718457:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718856:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718864:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.718871:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448369.719904:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789448369.719914:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391422696474ns, next at 392422694188ns, rc = 0 00010000:00010000:2.0:1789448369.720049:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720061:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720070:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720078:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720084:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720090:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720170:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448369.720192:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720199:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720206:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.720237:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720246:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720257:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311300) 00010000:00010000:2.0:1789448369.720261:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789448369.720265:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720271:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720292:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720299:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720305:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720317:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.720320:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720326:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720334:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448369.720336:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.720340:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.720345:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26800/0xe29566c2465fa4d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448369.720355:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f55c86d reply state 00000000b78ac7b8 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.720363:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448369.720454:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+37:11565:x1876372295339648:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2380us (2786us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789448369.720463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 197 00010000:00010000:3.0:1789448369.724751:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448369.724767:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.724778:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448369.724784:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.724793:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.724813:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97d9d6311300) 00010000:00010000:3.0:1789448369.724816:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789448369.724821:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.724841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.724862:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448369.724864:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448369.724866:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448369.725117:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725126:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725133:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725139:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448369.725143:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725149:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725157:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311a00) 00010000:00010000:3.0:1789448369.725160:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448369.725163:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448369.725169:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.771586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.771691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295339904 00000100:00100000:2.0:1789448369.771701:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295339904 00000100:00100000:2.0:1789448369.771773:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:2.0:1789448369.771784:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+36:11571:x1876372295339904:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448369.771808:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448369.771832:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef86 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.771983:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.771999:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.772012:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.772028:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.772035:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.772041:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789448369.773078:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789448369.773627:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773644:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773656:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773904:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773926:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773933:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773940:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448369.773944:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.773952:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.774109:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448369.774112:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448369.774117:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.774124:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa4f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448369.774143:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c065f9c reply state 00000000165f3be9 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.774153:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789448369.774191:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa4ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.774207:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.774277:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448369.774279:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448369.774282:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2a00, rc 0) 00000100:00100000:2.0:1789448369.774358:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+39:11571:x1876372295339904:12345-192.168.202.54@tcp:101:bash.0 Request processed in 2576us (2783us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789448369.774368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00010000:00010000:0.0:1789448369.781572:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781592:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781600:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781606:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448369.781611:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781619:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781635:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311b00) 00010000:00010000:0.0:1789448369.781639:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448369.781644:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.781651:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa4fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448369.786496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448369.786613:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340032 00000100:00100000:2.0:1789448369.786624:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340032 00000100:00100000:2.0:1789448369.786698:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1789448369.786709:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2350:x1876372295340032:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448369.786729:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448369.786753:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef8d expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448369.786792:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448369.786814:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1789448369.786818:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448369.786827:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.786846:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.786859:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3a00, rc 0) 00000100:00100000:2.0:1789448369.786917:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295340032:12345-192.168.202.54@tcp:101:bash.0 Request processed in 210us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448369.786938:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00080000:3.0:1789448369.787249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448369.794951:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448369.795107:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340160 00000100:00100000:0.0:1789448369.795116:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340160 00000100:00100000:0.0:1789448369.795181:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789448369.795212:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:11571:x1876372295340160:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789448369.795252:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448369.795271:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef94 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.795301:0:10266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.795309:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448369.795314:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448369.795319:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.795352:0:10266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.795367:0:10266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448369.795382:0:10266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10266:1876372317354112:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448369.795468:0:10266:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368900 going to sleep for 11 seconds 00000100:00100000:1.0:1789448369.800365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448369.800503:0:10266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10266:1876372317354112:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448369.800549:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 7 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448369.800587:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448369.800659:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:11571:x1876372295340160:12345-192.168.202.54@tcp:101:bash.0 Request processed in 5448us (5729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448369.800668:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:2.0:1789448369.801323:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340288 00000100:00100000:2.0:1789448369.801332:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340288 00010000:00010000:2.0:1789448369.801365:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.801405:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:2.0:1789448369.801417:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295340288:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448369.801432:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448369.801455:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.801469:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.801504:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa510 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef8d expref: 7 pid: 6672 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.801533:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448369.801539:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448369.801547:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.801559:0:7613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448369.801747:0:7613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448369.801766:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7613:1876372317354240:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789448369.801845:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448369.808019:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7613:1876372317354240:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789448369.808052:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448369.808120:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2351:x1876372295340288:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6705us (7925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448369.808139:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1789448369.812479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448369.812716:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340544 00000100:00100000:3.0:1789448369.812727:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340544 00000100:00100000:3.0:1789448369.812787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789448369.812797:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+38:11571:x1876372295340544:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1789448369.813166:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+39:11571:x1876372295340544:12345-192.168.202.54@tcp:35:bash.0 Request processed in 369us (694us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789448369.813174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:1.0:1789448370.023671:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.024792:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340672 00000100:00100000:2.0:1789448370.024806:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340672 00000100:00100000:2.0:1789448370.024877:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:2.0:1789448370.024888:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+39:11587:x1876372295340672:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448370.024915:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.024951:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533ef9b expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025154:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025169:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025182:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448370.025391:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789448370.025395:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448370.025413:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025438:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef9b expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025460:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef9b expref: 40 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.025469:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448370.025471:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448370.025475:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3400, rc 0) 00000100:00100000:2.0:1789448370.025764:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+40:11587:x1876372295340672:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 878us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.025771:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:1.0:1789448370.032356:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.032443:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295340928 00000100:00100000:3.0:1789448370.032452:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295340928 00000100:00100000:3.0:1789448370.032509:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:3.0:1789448370.032519:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+40:11587:x1876372295340928:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448370.032596:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448370.032624:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa52c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efa2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.032724:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.032738:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.032750:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448370.032762:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789448370.032893:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa52c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa2 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.032911:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa2 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.032934:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:3.0:1789448370.032937:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448370.032940:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26600, rc 0) 00000100:00100000:3.0:1789448370.033043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+42:11587:x1876372295340928:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 524us (696us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789448370.033051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1789448370.044443:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.044664:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341312 00000100:00100000:3.0:1789448370.044674:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341312 00000100:00100000:1.0:1789448370.044843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.044923:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341184 00000100:00100000:2.0:1789448370.044927:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341184 00000100:00100000:2.0:1789448370.044990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:2.0:1789448370.045000:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+43:11587:x1876372295341184:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448370.045026:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.045047:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa541 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.045139:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.045164:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.045176:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448370.045189:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789448370.045360:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa541 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa9 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.045381:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa9 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.045390:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448370.045392:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789448370.045396:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3200, rc 0) 00000100:00100000:2.0:1789448370.045462:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+45:11587:x1876372295341184:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 463us (619us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789448370.045469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:3.0:1789448370.045831:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789448370.045842:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+44:2349:x1876372295341312:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448370.045852:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448370.045869:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa2 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.045882:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:3.0:1789448370.045885:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448370.045954:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+43:2349:x1876372295341312:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 114us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448370.045961:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789448370.056627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.056728:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341440 00000100:00100000:2.0:1789448370.056739:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341440 00000100:00100000:2.0:1789448370.056799:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789448370.056809:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+6:2350:x1876372295341440:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:2.0:1789448370.056852:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.056871:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.056895:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448370.056900:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448370.056905:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.056952:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.057210:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 6 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.057256:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317354368:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448370.057393:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1789448370.063026:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876372317354368:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448370.063062:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448370.064029:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.064182:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341568 00000100:00100000:3.0:1789448370.064192:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341568 00002000:00100000:3.0:1789448370.064273:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97d9ead5dc00 x1876372295341568/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:231/0 lens 504/0 e 0 to 0 dl 1789448381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448370.064286:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead5dc00 with x1876372295341568 ext(0->8) 00010000:00010000:3.0:1789448370.064293:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 7 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.064325:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 7 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448370.064333:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead5dc00 00000100:00100000:3.0:1789448370.064358:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:3.0:1789448370.064367:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295341568:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:3.0:1789448370.065014:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295341568:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 644us (985us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789448370.065023:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00002000:00100000:3.0:1789448370.065032:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97d9ead5dc00 x1876372295341568/t4294967308(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:231/0 lens 504/448 e 0 to 0 dl 1789448381 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789448370.065042:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead5dc00 with x1876372295341568 ext(0->8) 00010000:00010000:3.0:1789448370.065049:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.065064:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448370.065071:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97d9ead5dc00 00000100:00100000:0.0:1789448370.070894:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.071149:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341696 00000100:00100000:3.0:1789448370.071162:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341696 00010000:00010000:3.0:1789448370.071205:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.071439:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:2.0:1789448370.071452:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c70be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2349:x1876372295341696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448370.071467:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789448370.071501:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789448370.071569:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789448369 00002000:00010000:2.0:1789448370.071572:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789448370 00002000:00010000:2.0:1789448370.071580:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789448369 00010000:00010000:2.0:1789448370.071588:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.071602:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.071755:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc8d1d55/0xe29566c2465fa517 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef94 expref: 9 pid: 10266 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.071773:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448370.071778:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789448370.071784:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.071792:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.071828:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448370.071947:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c70be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2349:x1876372295341696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 498us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.071955:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:3.0:1789448370.072126:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072135:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072160:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072168:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072175:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072182:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448370.072186:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072194:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072204:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.072252:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448370.072299:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295341440:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 15491us (15683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448370.072306:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789448370.076378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.076573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295341952 00000100:00100000:3.0:1789448370.076584:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295341952 00000100:00100000:0.0:1789448370.076855:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:0.0:1789448370.076866:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2dec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+43:11587:x1876372295341952:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:0.0:1789448370.076932:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa9 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448370.077195:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789448370.077292:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789448370.078076:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789448370.078141:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.078161:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.078171:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.078211:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.078301:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 47 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448370.078334:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317354496:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448370.078487:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448370.082922:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876372317354496:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448370.083078:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448370.084451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.084540:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342080 00000100:00100000:3.0:1789448370.084549:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342080 00010000:00010000:3.0:1789448370.084588:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 48 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448370.084639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:3.0:1789448370.084649:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+48:2350:x1876372295342080:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448370.084664:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448370.084671:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 48 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.084856:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 48 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.084879:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef86 expref: 48 pid: 5833 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.084897:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:3.0:1789448370.084917:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.084928:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.084935:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.085088:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448370.085151:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+47:2350:x1876372295342080:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 502us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.085159:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00010000:00010000:0.0:1789448370.085545:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.085555:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448370.085835:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789448370.086117:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789448370.086433:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317354624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789448370.086528:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448370.086566:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448370.086848:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317354624 00000100:00100000:3.0:1789448370.086856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317354624 00000100:00100000:3.0:1789448370.086912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448370.086921:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1876372317354624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789448370.087013:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1876372317354624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448370.087019:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789448370.088070:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448370.088115:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317354624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789448370.088641:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789448370.088926:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317354752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789448370.088989:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448370.089027:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448370.089155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317354752 00000100:00100000:3.0:1789448370.089162:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317354752 00000100:00100000:3.0:1789448370.089212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448370.089251:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1876372317354752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789448370.089422:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1876372317354752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (432us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789448370.089430:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789448370.089556:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876372317354752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789448370.089608:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789448370.089667:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089689:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089698:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089704:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448370.089709:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089717:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089742:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:1.0:1789448370.089746:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789448370.089752:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.089759:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa55d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448370.089928:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789448370.090033:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789448370.090043:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391792825092ns, next at 392792823169ns, rc = 0 00000001:00080000:1.0:1789448370.090049:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789448370.090080:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:1.0:1789448370.090084:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789448370.090091:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efa9 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448370.090198:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2dec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+50:11587:x1876372295341952:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 13334us (13829us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789448370.090206:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000020:00080000:1.0:1789448370.090210:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789448370.095892:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.095999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342208 00000100:00100000:2.0:1789448370.096023:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342208 00000100:00100000:2.0:1789448370.096088:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:2.0:1789448370.096099:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+50:11587:x1876372295342208:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448370.096124:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.096150:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efb0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.096205:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb0 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.096258:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb0 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.096277:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.096281:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448370.096284:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc3a00, rc 0) 00000100:00100000:2.0:1789448370.096346:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+51:11587:x1876372295342208:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 249us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.096353:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:3.0:1789448370.102876:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448370.103069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342464 00000100:00100000:0.0:1789448370.103092:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342464 00000100:00100000:0.0:1789448370.103158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:0.0:1789448370.103169:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+51:11587:x1876372295342464:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448370.103455:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+52:11587:x1876372295342464:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 287us (588us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789448370.103464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1789448370.111819:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.111863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.111904:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.112359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342848 00000100:00100000:2.0:1789448370.112370:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342848 00000100:00100000:2.0:1789448370.112441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:2.0:1789448370.112451:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295342848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448370.112554:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295342848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 103us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.112561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:3.0:1789448370.112712:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342720 00000100:00100000:3.0:1789448370.112717:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342720 00000100:00080000:1.0:1789448370.112807:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448370.112879:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:2.0:1789448370.112902:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2348:x1876372295342720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448370.112943:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2348:x1876372295342720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.112950:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:0.0:1789448370.113356:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342592 00000100:00100000:0.0:1789448370.113362:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342592 00000100:00100000:0.0:1789448370.113396:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:0.0:1789448370.113405:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295342592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448370.113442:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295342592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448370.113449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:2.0:1789448370.214996:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448370.215101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295342976 00000100:00100000:0.0:1789448370.215111:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295342976 00000100:00100000:0.0:1789448370.215169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:0.0:1789448370.215178:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+52:11597:x1876372295342976:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1789448370.215287:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215303:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215314:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215329:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215351:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215357:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215456:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215464:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215470:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448370.215533:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215546:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215552:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215558:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215564:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448370.215568:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215575:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215594:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448370.215597:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448370.215612:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215618:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fa56b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215631:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215638:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215643:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215649:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448370.215652:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215658:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d0030900) 00010000:00010000:0.0:1789448370.215668:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448370.215671:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215676:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215704:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215709:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215715:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215719:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448370.215721:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215727:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215734:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448370.215736:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448370.215739:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448370.215743:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448370.219978:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+52:11597:x1876372295342976:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 4787us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.219995:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:1.0:1789448370.291043:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.291207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295343232 00000100:00100000:2.0:1789448370.291248:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295343232 00000100:00100000:2.0:1789448370.291324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:2.0:1789448370.291336:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+52:11600:x1876372295343232:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448370.291362:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.291401:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efb7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291504:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291519:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291532:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291549:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291556:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291562:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291706:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291715:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291722:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448370.291732:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789448370.291829:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291838:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291844:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291850:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448370.291854:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291861:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291872:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448370.291875:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448370.291880:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291897:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2a00/0xe29566c2465fa587 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291911:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291917:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291922:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291927:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448370.291930:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291936:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291943:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9d6311200) 00010000:00010000:2.0:1789448370.291945:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448370.291948:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291954:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa58e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.291994:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3200/0xe29566c2465fa580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.292011:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb7 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.292024:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.292026:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448370.292029:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0400, rc 0) 00000100:00100000:2.0:1789448370.292098:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:11600:x1876372295343232:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 763us (1065us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789448370.292105:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:3.0:1789448370.299588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.300629:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295343360 00000100:00100000:1.0:1789448370.300642:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295343360 00000100:00100000:1.0:1789448370.300712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:1.0:1789448370.300723:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+54:11600:x1876372295343360:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1789448370.300798:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300816:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300830:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300855:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300862:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300869:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300875:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448370.300879:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300886:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300897:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448370.300900:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448370.300918:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.300925:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fa5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448370.301174:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+54:11600:x1876372295343360:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 450us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.301182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:2.0:1789448370.307142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.307561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295343616 00000100:00100000:3.0:1789448370.307573:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295343616 00000100:00100000:3.0:1789448370.307687:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1789448370.307698:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+54:11600:x1876372295343616:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789448370.307986:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:11600:x1876372295343616:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 289us (851us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789448370.307995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00010000:00010000:3.0:1789448370.329726:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448370.419804:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.420096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295343872 00000100:00100000:2.0:1789448370.420107:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295343872 00000100:00100000:2.0:1789448370.420181:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1789448370.420192:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+55:11610:x1876372295343872:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448370.420243:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.420246:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789448370.420271:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3400/0xe29566c2465fa525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef9b expref: 55 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420294:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448370.420299:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448370.420312:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efbe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420405:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420420:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420450:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448370.420462:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789448370.420633:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efbe expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420652:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efbe expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.420659:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.420662:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448370.420665:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1600, rc 0) 00000100:00100000:2.0:1789448370.421164:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+56:11610:x1876372295343872:12345-192.168.202.54@tcp:101:bash.0 Request processed in 973us (1371us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789448370.421173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1789448370.427607:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448370.427795:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344000 00000100:00100000:3.0:1789448370.427805:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344000 00000100:00100000:3.0:1789448370.427872:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789448370.427881:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+56:2348:x1876372295344000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448370.427894:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448370.427916:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efbe expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.427931:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448370.427940:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448370.427993:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+55:2348:x1876372295344000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448370.428003:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789448370.429527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.429598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344256 00000100:00100000:2.0:1789448370.429607:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344256 00000100:00100000:2.0:1789448370.429665:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:2.0:1789448370.429675:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+55:11610:x1876372295344256:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1789448370.429730:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448370.429753:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.429774:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.429803:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448370.430013:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.430027:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.430038:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448370.430094:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789448370.430119:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6526dd2 reply state 000000004c716be3 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.430128:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448370.430439:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+57:11610:x1876372295344256:12345-192.168.202.54@tcp:36:bash.0 Request processed in 765us (919us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789448370.430445:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00000020:00080000:2.0:1789448370.430449:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789448370.436760:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1789448370.438068:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438087:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438096:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438125:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448370.438131:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438140:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438160:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448370.438163:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448370.438169:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448370.438176:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa5bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.438785:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344384 00000100:00100000:2.0:1789448370.438796:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344384 00000100:00100000:2.0:1789448370.438918:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:2.0:1789448370.438930:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+56:11610:x1876372295344384:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448370.438954:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.438974:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efc5 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439062:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439077:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439112:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448370.439143:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789448370.439148:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448370.439167:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439195:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 58 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439253:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 57 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.439262:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.439265:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448370.439268:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1600, rc 0) 00000100:00100000:2.0:1789448370.439348:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+57:11610:x1876372295344384:12345-192.168.202.54@tcp:101:bash.0 Request processed in 421us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.439355:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:3.0:1789448370.443825:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448370.444436:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344640 00000100:00100000:0.0:1789448370.444447:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344640 00000100:00100000:0.0:1789448370.444524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:0.0:1789448370.444534:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+57:11610:x1876372295344640:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:0.0:1789448370.444778:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+58:11610:x1876372295344640:12345-192.168.202.54@tcp:35:bash.0 Request processed in 244us (962us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789448370.444800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1789448370.547363:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.547432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344768 00000100:00100000:1.0:1789448370.547443:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344768 00000100:00100000:1.0:1789448370.547571:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:1.0:1789448370.547582:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+58:11616:x1876372295344768:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448370.547623:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448370.547646:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa5d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547718:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547734:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547747:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448370.547792:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789448370.547794:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448370.547807:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547843:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa5d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efcc expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547866:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efcc expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.547872:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448370.547875:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448370.547877:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448370.548137:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295344768:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 556us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.548144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:0.0:1789448370.551359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.551401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295344896 00000100:00100000:1.0:1789448370.551416:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295344896 00000100:00100000:1.0:1789448370.551483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:1.0:1789448370.551494:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295344896:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448370.551525:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448370.551548:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efd3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551615:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551630:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551643:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551670:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551679:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551685:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551792:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551801:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551808:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448370.551843:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789448370.551858:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448370.551879:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551892:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551899:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551906:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551921:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551926:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448370.551930:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551939:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551952:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448370.551955:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448370.551960:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551966:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa5e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551979:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551985:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551990:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.551995:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448370.551998:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552015:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552023:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9e0bd6200) 00010000:00010000:1.0:1789448370.552026:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448370.552028:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552034:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552067:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efd3 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552081:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efd3 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.552089:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448370.552091:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448370.552094:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35e00, rc 0) 00000100:00100000:1.0:1789448370.552165:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11616:x1876372295344896:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 672us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.552172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:3.0:1789448370.555393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.555529:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345024 00000100:00100000:2.0:1789448370.555539:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345024 00000100:00100000:2.0:1789448370.555600:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789448370.555607:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+60:2349:x1876372295345024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448370.555752:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448370.555778:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35e00/0xe29566c2465fa5f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efd3 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.555816:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.555820:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448370.555870:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+59:2349:x1876372295345024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 262us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.555878:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448370.557372:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.557413:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345280 00000100:00100000:2.0:1789448370.557422:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345280 00000100:00100000:2.0:1789448370.557462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:2.0:1789448370.557473:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295345280:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448370.557506:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448370.557527:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efda expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.557634:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.557650:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 60 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.557660:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.557773:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 60 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.557787:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 60 pid: 7825 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.557818:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317354880:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448370.557899:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448370.562839:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317354880:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448370.562872:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448370.563396:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.563520:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345408 00000100:00100000:2.0:1789448370.563529:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345408 00010000:00010000:2.0:1789448370.563564:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 61 pid: 7825 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448370.563609:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1789448370.563619:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+61:2350:x1876372295345408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448370.563637:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448370.563644:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 61 pid: 7825 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563658:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 61 pid: 7825 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563691:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa5cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efc5 expref: 61 pid: 7825 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563709:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.563714:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563723:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563752:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.563785:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448370.564073:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.564088:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448370.564108:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789448370.564309:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.564328:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.564336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448370.564339:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789448370.564341:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0400, rc 0) 00000100:00100000:2.0:1789448370.566260:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+61:2350:x1876372295345408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2630us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.566275:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:1.0:1789448370.572250:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11616:x1876372295345280:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 14766us (14871us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789448370.572265:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:0.0:1789448370.579372:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448370.583190:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345664 00000100:00100000:2.0:1789448370.583232:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345664 00000100:00100000:2.0:1789448370.583309:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789448370.583320:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11616:x1876372295345664:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:2.0:1789448370.583338:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448370.583365:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efb0 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448370.583388:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448370.583394:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448370.583467:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295345664:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 149us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448370.583486:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789448370.586984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.587133:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345792 00000100:00100000:1.0:1789448370.587144:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345792 00000100:00100000:1.0:1789448370.587200:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:1.0:1789448370.587251:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295345792:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:1.0:1789448370.587367:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.587385:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.587398:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448370.587590:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789448370.587684:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295345792:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 436us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.587692:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:3.0:1789448370.590797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448370.590892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295345920 00000100:00100000:1.0:1789448370.590903:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295345920 00000100:00100000:1.0:1789448370.591066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:1.0:1789448370.591077:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d1015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+59:11616:x1876372295345920:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448370.591097:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448370.591116:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efe1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591169:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591179:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591199:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591253:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591265:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448370.591268:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448370.591272:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448370.591291:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34e00, rc 0) 00000100:00100000:1.0:1789448370.591350:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d1015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11616:x1876372295345920:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 275us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448370.591356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00000001:00080000:0.0:1789448371.017512:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789448371.017527:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1789448371.353391:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448371.482908:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448371.482934:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448371.483639:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789448371.483650:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448371.483782:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5509880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317355008:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789448371.483963:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789448371.508380:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5509880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317355008:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789448371.522632:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.532359:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295346048 00000100:00100000:1.0:1789448371.532376:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295346048 00000100:00100000:1.0:1789448371.532506:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1789448371.532520:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11618:x1876372295346048:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789448371.532564:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789448371.532679:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11618:x1876372295346048:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 162us (10057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.532686:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00080000:0.0:1789448371.533389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448371.539176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.539386:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295346176 00000100:00100000:2.0:1789448371.539395:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295346176 00000100:00100000:2.0:1789448371.539477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:2.0:1789448371.539489:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11618:x1876372295346176:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.539583:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539606:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539619:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539637:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539646:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539652:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539676:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539684:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539691:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448371.539733:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789448371.539738:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448371.539751:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539762:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539779:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539786:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539793:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448371.539798:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539805:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539817:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:2.0:1789448371.539820:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448371.539826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa621 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539846:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539851:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539856:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539861:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a0a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448371.539869:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539876:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539884:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97d9d6311900) 00010000:00010000:2.0:1789448371.539887:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448371.539890:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa628 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539913:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539919:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539925:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539931:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448371.539934:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539940:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539960:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448371.539962:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448371.539971:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.539978:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.540055:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11618:x1876372295346176:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 568us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.540063:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:3.0:1789448371.552713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.552931:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295346432 00000100:00100000:1.0:1789448371.552941:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295346432 00000100:00100000:1.0:1789448371.553088:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:1.0:1789448371.553098:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+60:11618:x1876372295346432:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.553118:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448371.553138:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa636 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efe8 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553656:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553672:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553700:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448371.553711:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789448371.553808:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553816:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553822:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553828:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448371.553832:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553839:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553851:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448371.553854:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789448371.553858:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553864:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa63d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.553901:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa636 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe8 expref: 62 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.554647:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:1.0:1789448371.554651:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448371.554657:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35600/0xe29566c2465fa636 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe8 expref: 62 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.554669:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35600, rc 0) 00000100:00100000:1.0:1789448371.554742:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295346432:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1644us (2037us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789448371.554751:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:0.0:1789448371.558388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.558626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295346560 00000100:00100000:2.0:1789448371.558637:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295346560 00000100:00100000:2.0:1789448371.558741:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:2.0:1789448371.558752:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295346560:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789448371.558792:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789448371.558887:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295346560:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 136us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.558895:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:2.0:1789448371.562939:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.563128:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295346816 00000100:00100000:1.0:1789448371.563138:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295346816 00000100:00100000:1.0:1789448371.563266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:1.0:1789448371.563277:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295346816:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.563296:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448371.563299:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789448371.563326:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fa5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efcc expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.563345:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:1.0:1789448371.563350:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448371.563363:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa64b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533efef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448371.563779:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789448371.564080:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.564109:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.564120:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.564173:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34a00/0xe29566c2465fa64b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efef expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.564189:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efef expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.564197:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9e0bd6a00) 00010000:00010000:1.0:1789448371.564200:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448371.564203:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35400, rc 0) 00000100:00100000:1.0:1789448371.564289:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+62:11618:x1876372295346816:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1369us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789448371.564298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:3.0:1789448371.569134:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.569265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347072 00000100:00100000:1.0:1789448371.569276:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347072 00000100:00100000:1.0:1789448371.569342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:1.0:1789448371.569355:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+62:11618:x1876372295347072:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.569434:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.569479:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efef expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.569505:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9e0bd6a00) 00010000:00010000:1.0:1789448371.569533:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448371.570884:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.570904:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.570916:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.571806:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.571816:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.571824:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.571894:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578720:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578747:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578754:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.578760:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578769:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578788:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:0.0:1789448371.578791:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448371.578798:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578804:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fa660 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578824:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578831:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578837:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578842:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.578863:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578869:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578877:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5ed7bee7 (ffff97d9d0030100) 00010000:00010000:0.0:1789448371.578880:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448371.578883:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.578889:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa667 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ed7bee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.580249:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295347072:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 10888us (11318us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448371.580261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:0.0:1789448371.584387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.584550:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347200 00000100:00100000:2.0:1789448371.584562:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347200 00000100:00100000:2.0:1789448371.584624:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:2.0:1789448371.584636:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+61:11618:x1876372295347200:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.584660:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448371.584688:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa66e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533eff6 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584733:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584764:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584776:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584886:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 63 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584905:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 62 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.584915:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448371.584918:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789448371.585704:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1e00, rc 0) 00000100:00100000:2.0:1789448371.585781:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+62:11618:x1876372295347200:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1145us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.585790:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:2.0:1789448371.595736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.598137:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347456 00000100:00100000:1.0:1789448371.598153:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347456 00000100:00100000:1.0:1789448371.598264:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:1.0:1789448371.598275:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+62:11618:x1876372295347456:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.598362:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.598379:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.598391:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448371.600875:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789448371.600891:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393303673592ns, next at 394303670304ns, rc = 0 00000004:00010000:1.0:1789448371.601461:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a098c07 reply state 00000000e102b4be transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.601486:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448371.601635:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+64:11618:x1876372295347456:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 3356us (5905us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789448371.601645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00010000:00010000:1.0:1789448371.606202:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606259:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606268:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606290:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448371.606296:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606304:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606322:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:1.0:1789448371.606325:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789448371.606330:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.606336:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa67c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.613664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.614821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347584 00000100:00100000:1.0:1789448371.614834:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347584 00000100:00100000:1.0:1789448371.614901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:1.0:1789448371.614912:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+63:11618:x1876372295347584:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.616245:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448371.616272:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533effd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.616339:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.616355:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.616403:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448371.616407:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448371.616411:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1600, rc 0) 00000100:00100000:2.0:1789448371.617881:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+64:11618:x1876372295347584:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2962us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.617891:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1789448371.623389:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448371.623821:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347712 00000100:00100000:3.0:1789448371.623832:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347712 00000100:00080000:0.0:1789448371.624076:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789448371.624283:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1789448371.624296:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2351:x1876372295347712:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789448371.624653:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2351:x1876372295347712:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 360us (1274us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789448371.624661:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1789448371.630912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.631395:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295347968 00000100:00100000:1.0:1789448371.631407:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295347968 00000100:00100000:1.0:1789448371.631716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:1.0:1789448371.631729:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+64:11618:x1876372295347968:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789448371.633355:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+65:11618:x1876372295347968:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1619us (2445us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789448371.633369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789448371.639380:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448371.639761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348224 00000100:00100000:3.0:1789448371.639772:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348224 00000100:00100000:3.0:1789448371.639889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:3.0:1789448371.639900:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+65:11618:x1876372295348224:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789448371.640042:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+65:11618:x1876372295348224:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 143us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448371.640050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:0.0:1789448371.649760:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.650053:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348352 00000100:00100000:2.0:1789448371.650064:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348352 00000100:00100000:2.0:1789448371.650141:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:2.0:1789448371.650153:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+65:11618:x1876372295348352:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.650175:0:7825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448371.650199:0:7825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa68a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f004 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650298:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650311:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650333:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448371.650367:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448371.650385:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650410:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fa68a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f004 expref: 67 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650446:0:7825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f004 expref: 66 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.650475:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448371.650478:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789448371.650482:0:7825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1800, rc 0) 00000100:00100000:2.0:1789448371.651257:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+66:11618:x1876372295348352:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1066us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.651266:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:0.0:1789448371.660399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.660871:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348480 00000100:00100000:1.0:1789448371.660898:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348480 00000100:00100000:1.0:1789448371.661082:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1789448371.661094:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2350:x1876372295348480:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.661117:0:10266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448371.661140:0:10266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f00b expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448371.661170:0:10266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d0b3, blocks: 0x1 00010000:00010000:1.0:1789448371.661194:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1789448371.661199:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448371.661207:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 11 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.661267:0:10266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 11 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.661281:0:10266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35400, rc 0) 00000100:00100000:1.0:1789448371.661338:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2350:x1876372295348480:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 246us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.661346:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789448371.670479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.670598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348736 00000100:00100000:1.0:1789448371.670606:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348736 00000100:00100000:1.0:1789448371.670656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:1.0:1789448371.670663:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+66:11618:x1876372295348736:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789448371.670770:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+66:11618:x1876372295348736:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.670795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:0.0:1789448371.678652:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.678745:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348864 00000100:00100000:2.0:1789448371.678756:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348864 00000100:00100000:2.0:1789448371.678814:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:2.0:1789448371.678825:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+11:11618:x1876372295348864:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.678843:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448371.678863:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f012 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.678895:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 12 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.678905:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448371.678910:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448371.678916:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 12 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.678980:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 12 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.678994:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 12 pid: 10266 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.679009:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317355136:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448371.679100:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448371.682891:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.683253:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295348992 00000100:00100000:1.0:1789448371.683264:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295348992 00010000:00010000:1.0:1789448371.683308:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 13 pid: 10266 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.683358:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:1.0:1789448371.683369:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+13:2351:x1876372295348992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448371.683387:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.683414:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 13 pid: 10266 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.683429:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 13 pid: 10266 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.683454:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448371.683459:0:7613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448371.683477:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 13 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.683486:0:7613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 13 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.683526:0:7613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 13 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.683559:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317355264:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448371.683642:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35180 going to sleep for 11 seconds 00010000:00010000:2.0:1789448371.685061:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099370f6f/0xe29566c2465fa698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f00b expref: 13 pid: 10266 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.685083:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1876372317355136:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448371.685120:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 12 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.685132:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0a00, rc 0) 00000100:00100000:2.0:1789448371.685190:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+12:11618:x1876372295348864:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 6366us (6548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.685198:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789448371.688213:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7613:1876372317355264:192.168.202.54@tcp:105: 00010000:00010000:1.0:1789448371.688277:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448371.688330:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2351:x1876372295348992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4961us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.688340:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1789448371.697326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.697523:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349120 00000100:00100000:2.0:1789448371.697532:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349120 00002000:00100000:2.0:1789448371.697581:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97d9fffaf800 x1876372295349120/t0(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:232/0 lens 504/0 e 0 to 0 dl 1789448382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448371.697615:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fffaf800 with x1876372295349120 ext(0->12) 00002000:00010000:2.0:1789448371.697620:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fffaf800 00000100:00100000:2.0:1789448371.697662:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448371.697672:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+11:2350:x1876372295349120:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789448371.698957:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+13:2350:x1876372295349120:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 1274us (1629us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789448371.698969:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00002000:00100000:2.0:1789448371.698978:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97d9fffaf800 x1876372295349120/t4294967320(0) o4->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:232/0 lens 504/448 e 0 to 0 dl 1789448382 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448371.698987:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9fffaf800 with x1876372295349120 ext(0->12) 00002000:00010000:2.0:1789448371.698992:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9fffaf800 00000100:00100000:2.0:1789448371.708837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448371.709016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349248 00000100:00100000:0.0:1789448371.709026:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349248 00000100:00100000:0.0:1789448371.709088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:0.0:1789448371.709175:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+66:11618:x1876372295349248:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789448371.751449:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:3.0:1789448371.751476:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9f5368e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789448371.751482:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9c6dd6400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9f5368f00 00000020:00080000:3.0:1789448371.751549:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9c6dd6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9f4fe6000 00000020:00080000:0.0:1789448371.751596:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789448371.751617:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+63:11618:x1876372295349248:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 42440us (42785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.751630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000001:00080000:3.0:1789448371.751651:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789448371.751662:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1789448371.751721:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789448371.751750:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9faf35000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789448371.751755:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d8c2026c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9faf35300 00000020:00080000:3.0:1789448371.751771:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d8c2026f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9fa6dcc00 00000020:00080000:1.0:1789448371.751787:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000004:00080000:3.0:1789448371.751801:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:0.0:1789448371.752283:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448371.752298:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317355392:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1789448371.752323:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789448371.752330:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448371.752338:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317355520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789448371.752346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448371.752363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448371.752390:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317355392 00000100:00100000:1.0:1789448371.752397:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317355392 00000100:00100000:1.0:1789448371.752444:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317355520 00000100:00080000:0.0:1789448371.752445:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448371.752448:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317355520 00000100:00100000:1.0:1789448371.752479:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448371.752487:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876372317355392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789448371.752510:0:10266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:2.0:1789448371.752531:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1789448371.752536:0:10266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.752572:0:10266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 12 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.752582:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789448371.752586:0:10266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448371.752592:0:10266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.752619:0:10266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 12 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.752634:0:10266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 12 pid: 10266 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.752647:0:10266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10266:1876372317355648:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448371.752680:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876372317355520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789448371.752692:0:10266:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9faf35180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448371.752769:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448371.752777:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317355776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789448371.752817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448371.752897:0:6671:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00010000:2.0:1789448371.753058:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789448371.753063:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789448371 00002000:00010000:2.0:1789448371.753065:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789448371.753067:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789448371 -> 1789448371 00002000:00010000:2.0:1789448371.753069:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789448371.753109:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1876372317355520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 569us (744us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789448371.753117:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789448371.753131:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317355776 00000100:00100000:2.0:1789448371.753142:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317355776 00000100:00100000:2.0:1789448371.753167:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789448371.753173:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317355776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789448371.753186:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789448371.753211:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8d0b1, atime: 0x6aa8d0b2, ctime: 0x6aa8d0b1, blocks: 0xb 00010000:00010000:2.0:1789448371.753237:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.753247:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1789448371.753250:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448371.753257:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.753275:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.753287:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.753295:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.753313:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448371.753712:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448371.753720:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.753729:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448371.753733:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.753743:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.753762:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.753770:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda2209a/0xe29566c2465fa6ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.753790:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448371.753792:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448371.753794:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448371.755367:0:6671:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:1.0:1789448371.755441:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9fb036680/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789448371.755451:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317355520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789448371.757076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.757330:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317355776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4155us (4510us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789448371.757342:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789448371.757367:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349376 00000100:00100000:2.0:1789448371.757382:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349376 00000100:00100000:1.0:1789448371.757587:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:1.0:1789448371.757600:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+13:2351:x1876372295349376:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789448371.757687:0:10266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10266:1876372317355648:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448371.757726:0:10266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.758199:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789448371.758206:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9f550a680, transno 4294967307 00000004:00080000:2.0:1789448371.758242:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1789448371.758264:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97d9fffadc00 x1876372317355776/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789448387 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789448371.758275:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9fffadc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789448371.758281:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317355776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789448371.758825:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.758862:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349504 00000100:00100000:1.0:1789448371.758868:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349504 00010000:00010000:1.0:1789448371.758895:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 14 pid: 10266 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.758927:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:1.0:1789448371.758938:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+14:2351:x1876372295349504:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448371.758962:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.759078:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 14 pid: 10266 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759093:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 14 pid: 10266 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759121:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b46f9084/0xe29566c2465fa468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef71 expref: 14 pid: 10266 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759140:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448371.759144:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448371.759151:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759174:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759209:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448371.759284:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+13:2351:x1876372295349504:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 348us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.759293:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00010000:00010000:1.0:1789448371.759363:0:10266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759374:0:10266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759385:0:10266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759393:0:10266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.759414:0:10266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448371.759722:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448371.759732:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.759816:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448371.759823:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.759833:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.759849:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.759857:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009462c4d0/0xe29566c2465fa6a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.759881:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448371.759883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448371.759892:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448371.759892:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1876372317355392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7403us (7542us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789448371.759901:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1789448371.760337:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9eada0e00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789448371.760345:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eada0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317355392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789448371.800862:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+12:2351:x1876372295349376:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 43254us (43780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448371.800877:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000001:00080000:2.0:1789448371.801083:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1789448371.801099:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1789448371.801105:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1789448371.818635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.818749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349760 00000100:00100000:1.0:1789448371.818760:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349760 00000100:00100000:1.0:1789448371.818876:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:1.0:1789448371.818887:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11618:x1876372295349760:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448371.818955:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.818985:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1800/0xe29566c2465fa691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f004 expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.819004:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:1.0:1789448371.819009:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448371.819037:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.819051:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.819061:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448371.819388:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083cfb1f3 reply state 000000005fce948b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.819397:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448371.819536:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+21:11618:x1876372295349760:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 650us (910us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789448371.819543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00010000:00010000:0.0:1789448371.822771:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822790:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822798:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822805:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.822810:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822818:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822835:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:0.0:1789448371.822838:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448371.822842:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.822859:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35200/0xe29566c2465fa6b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.823200:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.823718:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295349888 00000100:00100000:1.0:1789448371.823730:0:12513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295349888 00000100:00100000:1.0:1789448371.823784:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1789448371.823794:0:12513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2351:x1876372295349888:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789448371.824112:0:12513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789448371.824124:0:12513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789448371 -> 1789448370 00002000:00010000:1.0:1789448371.824127:0:12513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789448370 00002000:00010000:1.0:1789448371.824129:0:12513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789448371 -> 1789448370 00002000:00010000:1.0:1789448371.824132:0:12513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789448371.824261:0:12513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295349888:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 467us (1064us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789448371.824269:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1789448371.826874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.827047:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350144 00000100:00100000:2.0:1789448371.827057:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350144 00000100:00100000:2.0:1789448371.827151:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1789448371.827162:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+20:11618:x1876372295350144:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789448371.827277:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.827296:0:7825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.827305:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.827342:0:7825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.827356:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 20 pid: 7825 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.827371:0:7825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317355904:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448371.827459:0:7825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448371.830989:0:7825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1876372317355904:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448371.831019:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448371.831739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448371.832147:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350272 00000100:00100000:2.0:1789448371.832169:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350272 00010000:00010000:2.0:1789448371.832207:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 21 pid: 7825 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.832397:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:2.0:1789448371.832410:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+21:2350:x1876372295350272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448371.832425:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448371.832432:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 21 pid: 7825 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832445:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 21 pid: 7825 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832477:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fa675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eff6 expref: 21 pid: 7825 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832503:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:2.0:1789448371.832508:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832517:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832526:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.832552:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448371.832602:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+20:2350:x1876372295350272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 195us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.832618:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00010000:00010000:3.0:1789448371.832674:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832683:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832712:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832720:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832727:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832732:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:3.0:1789448371.832736:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832743:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832753:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:3.0:1789448371.832755:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789448371.832759:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.832778:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc2600/0xe29566c2465fa6bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448371.832818:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11618:x1876372295350144:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 5658us (5952us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789448371.832827:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1789448371.837582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448371.837662:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350400 00000100:00100000:3.0:1789448371.837670:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350400 00000100:00100000:3.0:1789448371.837717:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:3.0:1789448371.837724:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295350400:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789448371.837763:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.837780:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.837787:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448371.837791:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448371.837794:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.837828:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.837842:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 8 pid: 6672 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448371.837877:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317356032:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448371.837956:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448371.840321:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1876372317356032:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448371.840345:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.843825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.843916:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350528 00000100:00100000:1.0:1789448371.843935:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350528 00010000:00010000:1.0:1789448371.843977:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 9 pid: 6672 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.844025:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:1.0:1789448371.844036:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+9:2350:x1876372295350528:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448371.844051:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.844072:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 9 pid: 6672 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.844086:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 9 pid: 6672 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.844110:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce54a70/0xe29566c2465fa69f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f012 expref: 9 pid: 6672 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.844131:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448371.844136:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448371.844154:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.844164:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.844198:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448371.844296:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2350:x1876372295350528:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 262us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.844305:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00010000:00010000:3.0:1789448371.844437:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844447:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844481:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844495:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844503:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844510:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448371.844515:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844536:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844549:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.844557:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032f4da98/0xe29566c2465fa6c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448371.844609:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2350:x1876372295350400:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 6884us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448371.844616:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789448371.852976:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448371.853105:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350784 00000100:00100000:3.0:1789448371.853116:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350784 00000100:00100000:3.0:1789448371.853175:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1789448371.853184:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11618:x1876372295350784:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789448371.853295:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853325:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853551:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853578:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853586:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853619:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.853632:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 20 pid: 5834 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448371.853647:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317356160:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448371.853745:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d185ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448371.857662:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448371.857747:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317356160:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448371.857773:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.857837:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295350912 00000100:00100000:0.0:1789448371.857844:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295350912 00010000:00010000:0.0:1789448371.857875:0:7613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 21 pid: 5834 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.857911:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:0.0:1789448371.857925:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+21:2351:x1876372295350912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448371.857939:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448371.857953:0:7613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 21 pid: 5834 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.857965:0:7613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 21 pid: 5834 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.857988:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1600/0xe29566c2465fa683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533effd expref: 21 pid: 5834 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.858004:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:0.0:1789448371.858009:0:7613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.858019:0:7613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.858045:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.858070:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448371.858123:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+20:2351:x1876372295350912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 205us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448371.858130:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00010000:00010000:3.0:1789448371.858254:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448371.858262:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789448371.858435:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789448371.858582:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789448371.858618:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789448371.858685:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317356288:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789448371.858732:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448371.858752:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c11ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448371.858961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317356288 00000100:00100000:0.0:1789448371.858967:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317356288 00000100:00100000:0.0:1789448371.858999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448371.859006:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876372317356288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789448371.859068:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876372317356288:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448371.859075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448371.859101:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1789448371.859106:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1789448371.859123:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9fb036680, transno 4294967321 00000100:00100000:0.0:1789448371.859134:0:5835:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97d9eada0e00 x1876372317355392/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789448387 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448371.859145:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce825880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317356288:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789448371.859566:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789448371.859622:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317356416:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789448371.859653:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448371.859669:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448371.859682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317356416 00000100:00100000:0.0:1789448371.859686:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317356416 00000100:00100000:0.0:1789448371.859711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448371.859717:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876372317356416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789448371.859860:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1876372317356416:12345-0@lo:1000:mdt00_002.0 Request processed in 142us (204us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789448371.859866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448371.859896:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876372317356416:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789448371.859921:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859931:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859938:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859945:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.859950:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859958:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859972:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d6311900) 00010000:00010000:0.0:1789448371.859975:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448371.859979:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.859986:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27600/0xe29566c2465fa6d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860013:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860024:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860030:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860034:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.860037:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860042:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860048:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448371.860050:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789448371.860055:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860064:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860072:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.860093:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.860102:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317356544:192.168.202.54@tcp:105: 00000100:00100000:0.0:1789448371.860156:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c7db0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448371.865406:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876372317356544:192.168.202.54@tcp:105: 00010000:00010000:0.0:1789448371.865441:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865452:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa613 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865504:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865519:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865530:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865541:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865546:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865553:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865560:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.865564:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865571:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865601:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448371.865604:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448371.865608:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865614:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865625:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865631:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865636:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865641:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448371.865644:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865649:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865656:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448371.865659:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789448371.865662:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.865667:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27c00/0xe29566c2465fa6c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448371.866162:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11618:x1876372295350784:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 12976us (13193us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1789448371.866173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000020:00080000:0.0:1789448371.866179:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789448371.866320:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448371.866700:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295351040 00000100:00100000:0.0:1789448371.866708:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295351040 00000100:00100000:0.0:1789448371.866750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789448371.866759:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11616:x1876372295351040:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:0.0:1789448371.866859:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11616:x1876372295351040:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 101us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448371.866867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000040:00080000:3.0:1789448371.867770:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448371.867778:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448371.868762:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789448371.868773:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789448371.873869:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.873962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295351296 00000100:00100000:1.0:1789448371.873973:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295351296 00000100:00100000:1.0:1789448371.874036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:1.0:1789448371.874047:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11616:x1876372295351296:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:1.0:1789448371.874479:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789448371.874594:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11616:x1876372295351296:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 546us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.874602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:2.0:1789448371.880841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448371.880960:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295351552 00000100:00100000:0.0:1789448371.880971:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295351552 00000100:00100000:0.0:1789448371.881033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1789448371.881045:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2dec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+23:11618:x1876372295351552:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789448371.881768:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789448371.881865:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789448371.881915:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881932:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881943:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881951:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881964:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881970:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448371.881988:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789448371.882090:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2dec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+25:11618:x1876372295351552:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1046us (1258us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789448371.882098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000020:00080000:0.0:1789448371.882104:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789448371.882685:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448371.882692:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.882700:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448371.882704:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.882712:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.882724:0:8432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97d9d0030900) 00010000:00010000:2.0:1789448371.882726:0:8432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789448371.882731:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.882737:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fa6de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.882757:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448371.882758:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448371.882760:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448371.914696:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.914803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295351680 00000100:00100000:1.0:1789448371.914813:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295351680 00000100:00100000:1.0:1789448371.914876:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:1.0:1789448371.914887:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+25:11620:x1876372295351680:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448371.914912:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448371.914946:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fa6e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f019 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915016:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915056:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915071:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915078:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915083:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915326:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915337:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915345:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915378:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.915391:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 26 pid: 5833 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.915416:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317356672:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789448371.915506:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad000 going to sleep for 11 seconds 00000100:00100000:1.0:1789448371.919521:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876372317356672:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789448371.919551:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448371.919838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448371.919933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295351936 00000100:00100000:0.0:1789448371.919940:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295351936 00000100:00100000:0.0:1789448371.919997:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789448371.920007:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+27:5589:x1876372295351936:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789448371.920274:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+28:5589:x1876372295351936:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 267us (435us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789448371.920283:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:3.0:1789448371.923041:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448371.923184:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295352064 00000100:00100000:1.0:1789448371.923194:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295352064 00010000:00010000:1.0:1789448371.923261:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 28 pid: 5833 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448371.923290:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:1.0:1789448371.923299:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+28:2351:x1876372295352064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448371.923312:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448371.923318:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 28 pid: 5833 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923328:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 28 pid: 5833 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923350:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0400/0xe29566c2465fa605 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efda expref: 28 pid: 5833 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923367:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448371.923372:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923393:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923400:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448371.923434:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448371.923499:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+27:2351:x1876372295352064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448371.923506:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00010000:00010000:2.0:1789448371.923638:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923646:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448371.923688:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789448371.923693:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448371.923712:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923724:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923735:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923742:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923749:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923755:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448371.923759:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923766:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923775:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:2.0:1789448371.923785:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448371.923789:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923796:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34200/0xe29566c2465fa6ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923807:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923813:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923819:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923824:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35c00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448371.923827:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923832:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923840:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97d9e0bd6000) 00010000:00010000:2.0:1789448371.923842:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448371.923845:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923850:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35c00/0xe29566c2465fa6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923886:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fa6e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f019 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923911:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f019 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448371.923929:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448371.923932:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448371.923934:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34400, rc 0) 00000100:00100000:2.0:1789448371.923959:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11620:x1876372295351680:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 9075us (9275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448371.923966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00010000:00010000:1.0:1789448372.378415:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448372.662292:0:12551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448372.662301:0:12551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448372.662347:0:12551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789448372.662353:0:12551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789448372.889412:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789448372.889432:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448372.889493:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789448372.889500:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448372.889647:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317356800:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789448372.889756:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c11ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448372.901341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448372.901383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295352192 00000100:00100000:1.0:1789448372.901393:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295352192 00000100:00100000:1.0:1789448372.901519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:1.0:1789448372.901530:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+27:11632:x1876372295352192:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1789448372.901557:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ce827800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1876372317356800:192.168.202.54@tcp:107:hsm_cdtr.0 00000004:00000080:1.0:1789448372.901575:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789448372.901692:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11632:x1876372295352192:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 164us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448372.901700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:2.0:1789448372.906075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448372.906263:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295352448 00000100:00100000:0.0:1789448372.906275:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295352448 00000100:00100000:0.0:1789448372.906338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:0.0:1789448372.906348:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+26:11632:x1876372295352448:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448372.906375:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448372.906399:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa701 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f020 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.906531:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.906561:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.906575:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448372.906589:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789448372.906728:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33200/0xe29566c2465fa701 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f020 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.906748:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f020 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.906757:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448372.906760:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448372.906764:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448372.907020:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11632:x1876372295352448:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 672us (954us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789448372.907028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:3.0:1789448372.912671:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448372.914503:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295352704 00000100:00100000:2.0:1789448372.914516:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295352704 00000100:00100000:2.0:1789448372.914698:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:2.0:1789448372.914711:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11632:x1876372295352704:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789448372.914794:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448372.914813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1789448372.914813:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.914825:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448372.914874:0:7613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295352832 00000100:00100000:0.0:1789448372.914880:0:7613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295352832 00000100:00100000:0.0:1789448372.914921:0:7613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789448372.914927:0:7613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:2351:x1876372295352832:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448372.914939:0:7613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448372.914955:0:7613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fa708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f020 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448372.914987:0:7613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:0.0:1789448372.914992:0:7613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448372.915046:0:7613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+29:2351:x1876372295352832:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448372.915052:0:7613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00010000:00010000:2.0:1789448372.915061:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915068:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915081:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915087:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3a00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448372.915092:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915100:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915109:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:2.0:1789448372.915111:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789448372.915115:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448372.915121:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3a00/0xe29566c2465fa716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448372.917150:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11632:x1876372295352704:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 2432us (4480us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789448372.917174:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:3.0:1789448372.922549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448372.922817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353088 00000100:00100000:1.0:1789448372.922832:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353088 00000100:00100000:1.0:1789448372.922921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789448372.922935:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+28:11632:x1876372295353088:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1789448372.923118:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448372.923128:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789448372.923323:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11632:x1876372295353088:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 390us (846us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789448372.923333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000040:00080000:0.0:1789448372.923583:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789448372.923594:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789448373.019292:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f57c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317357184:0@lo:400:kworker.0 00000100:00100000:1.0:1789448373.019367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448373.019521:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317356928:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.019570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448373.019611:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448373.019618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317357056:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.019641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448373.019690:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317356928 00000100:00100000:2.0:1789448373.019698:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317356928 00000100:00100000:2.0:1789448373.019767:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789448373.019777:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317356928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.019835:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317356928:12345-0@lo:400:kworker.0 Request processed in 58us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448373.019857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789448373.019922:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eafd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317356928:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.019953:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357184 00000100:00100000:2.0:1789448373.019957:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357184 00000100:00100000:2.0:1789448373.019993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357056 00000100:00100000:2.0:1789448373.019996:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357056 00000100:00100000:2.0:1789448373.020013:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789448373.020019:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317357184:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789448373.020125:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448373.020145:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789448373.020153:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317357056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448373.020192:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317357056:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448373.020198:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789448373.020274:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fac79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317357056:0@lo:400:kworker.0 00000100:00100000:3.0:1789448373.021572:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357312:0@lo:400:kworker.0 00000100:00100000:3.0:1789448373.021620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448373.021667:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357312 00000100:00100000:3.0:1789448373.021675:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357312 00000100:00100000:3.0:1789448373.021717:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789448373.021725:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317357312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448373.021764:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317357312:12345-0@lo:400:kworker.0 Request processed in 40us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448373.021770:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789448373.021794:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448373.021817:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357312:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.023449:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317357184:12345-0@lo:400:kworker.0 Request processed in 3420us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448373.023470:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789448373.023985:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317357568:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.024038:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448373.024076:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448373.024082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317357440:0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.024105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448373.024139:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357440 00000100:00100000:2.0:1789448373.024147:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357440 00000100:00100000:2.0:1789448373.024235:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789448373.024244:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317357440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448373.024304:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317357440:12345-0@lo:400:kworker.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448373.024327:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1789448373.024349:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448373.024376:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f57c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317357440:0@lo:400:kworker.0 00000100:00100000:0.0:1789448373.026301:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357568 00000100:00100000:0.0:1789448373.026313:0:12513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357568 00000100:00100000:0.0:1789448373.026383:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789448373.026394:0:12513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317357568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448373.026474:0:12513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317357568:12345-0@lo:400:kworker.0 Request processed in 83us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448373.026481:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789448373.027666:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448373.027719:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9fb036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317357568:0@lo:400:kworker.0 00000100:00100000:1.0:1789448373.028359:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f57c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317357184:0@lo:400:kworker.0 00010000:00010000:2.0:1789448373.403696:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448373.529531:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448373.529565:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448373.529637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448373.529820:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357696 00000100:00100000:1.0:1789448373.529829:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357696 00000100:00100000:1.0:1789448373.529895:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789448373.529905:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876372317357696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448373.529939:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448373.529987:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fb036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876372317357696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448373.529994:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789448373.530139:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448374.041640:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448374.041730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448374.041919:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357824 00000100:00100000:2.0:1789448374.041928:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357824 00000100:00100000:2.0:1789448374.041975:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789448374.041983:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317357824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448374.042111:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448374.042160:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876372317357824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448374.042168:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789448374.042280:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317357824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448374.425469:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789448374.520174:0:12602:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448374.520188:0:12602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448374.520476:0:12602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789448374.520483:0:12602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789448374.725733:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448374.725774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353344 00000100:00100000:3.0:1789448374.725784:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353344 00000100:00100000:3.0:1789448374.725857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:3.0:1789448374.725868:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+29:11652:x1876372295353344:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789448374.725891:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448374.725914:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa71d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f027 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448374.726012:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa724 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448374.726028:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa724 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448374.726040:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa724 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448374.726074:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789448374.726205:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa71d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f027 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448374.726249:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f027 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448374.726259:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448374.726262:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789448374.726265:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26600, rc 0) 00000100:00100000:3.0:1789448374.726317:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+31:11652:x1876372295353344:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 451us (594us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789448374.726325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00080000:3.0:1789448374.726457:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448374.729927:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448374.730551:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353472 00000100:00100000:1.0:1789448374.730564:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353472 00000100:00100000:1.0:1789448374.730744:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:1.0:1789448374.730755:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+31:11652:x1876372295353472:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1789448374.730819:0:7825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730837:0:7825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730848:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730873:0:7825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730881:0:7825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730903:0:7825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730909:0:7825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448374.730913:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730922:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730933:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:1.0:1789448374.730937:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448374.730941:0:7825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448374.730949:0:7825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fa732 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448374.731023:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+31:11652:x1876372295353472:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 270us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448374.731031:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1789448374.841901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448374.841998:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353600 00000100:00100000:2.0:1789448374.842009:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353600 00000100:00100000:2.0:1789448374.842094:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:2.0:1789448374.842106:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295353600:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789448374.842125:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448374.842149:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b98ac29/0xe29566c2465fa739 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f02e expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448374.842180:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa8d0b2, atime: 0x6aa8d0b2, ctime: 0x6aa8d0b2, blocks: 0xb 00010000:00010000:2.0:1789448374.842203:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1789448374.842208:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448374.842258:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b98ac29/0xe29566c2465fa739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f02e expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448374.842279:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b98ac29/0xe29566c2465fa739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f02e expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448374.842293:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2a00, rc 0) 00000100:00100000:2.0:1789448374.842367:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fac79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2348:x1876372295353600:12345-192.168.202.54@tcp:101:cat.0 Request processed in 264us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448374.842374:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00080000:3.0:1789448374.842529:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448374.846095:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448374.846199:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353728 00000100:00100000:3.0:1789448374.846210:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353728 00002000:00100000:2.0:1789448374.846529:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97d9ead5f480 x1876372295353728/t0(0) o3->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:235/0 lens 488/0 e 0 to 0 dl 1789448385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448374.846540:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead5f480 with x1876372295353728 ext(0->4095) 00002000:00010000:2.0:1789448374.846546:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9ead5f480 00000100:00100000:2.0:1789448374.846674:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789448374.846686:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295353728:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:2.0:1789448374.846895:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+8:2351:x1876372295353728:12345-192.168.202.54@tcp:3:cat.0 Request processed in 210us (810us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789448374.846903:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00002000:00100000:2.0:1789448374.846910:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97d9ead5f480 x1876372295353728/t0(0) o3->a7263448-abed-44d6-a5e0-4aa81ee22270@192.168.202.54@tcp:235/0 lens 488/4536 e 0 to 0 dl 1789448385 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789448374.846918:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97d9ead5f480 with x1876372295353728 ext(0->4095) 00002000:00010000:2.0:1789448374.846923:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97d9ead5f480 00000100:00100000:1.0:1789448375.231410:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448375.231597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448375.231647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448375.231726:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353984 00000100:00100000:0.0:1789448375.231739:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353984 00000100:00100000:3.0:1789448375.231744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354112 00000100:00100000:3.0:1789448375.231751:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354112 00000100:00100000:2.0:1789448375.231846:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295353856 00000100:00100000:2.0:1789448375.231859:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295353856 00000100:00100000:2.0:1789448375.231904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:2.0:1789448375.231915:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295353856:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448375.232002:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2349:x1876372295353856:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 88us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448375.232010:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:3.0:1789448375.235508:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:3.0:1789448375.235526:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2349:x1876372295354112:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448375.235640:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2349:x1876372295354112:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 119us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448375.235647:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00080000:1.0:1789448375.236498:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448375.236506:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448375.236930:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:0.0:1789448375.236943:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295353984:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448375.237010:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2349:x1876372295353984:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 71us (5363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448375.237017:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00010000:00010000:1.0:1789448375.449375:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789448376.160842:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1789448376.473324:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789448377.179168:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789448377.179197:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789448377.199915:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:2.0:1789448377.199958:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97d9f5368900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789448377.199964:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9eacb2300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97d9f5368f00 00000020:00080000:2.0:1789448377.199968:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97d9c78e4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97d9fff6d000 00000001:00080000:2.0:1789448377.199987:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1789448377.199998:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1789448377.200009:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1789448377.200075:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789448377.200293:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789448377.502749:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448378.138112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448378.138137:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317358080:0@lo:400:kworker.0 00000100:00100000:1.0:1789448378.138168:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317358336:0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.138211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448378.138213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448378.138323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317358464:0@lo:400:kworker.0 00000100:00100000:1.0:1789448378.138390:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448378.138398:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317358208:0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.143139:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317357952:0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.143209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448378.143267:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317358592:0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.143296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448378.143337:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358080 00000100:00100000:2.0:1789448378.143345:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358080 00000100:00100000:2.0:1789448378.143393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789448378.143402:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317358080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.145090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448378.145170:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358336 00000100:00100000:3.0:1789448378.145178:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358336 00000100:00100000:3.0:1789448378.145245:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358592 00000100:00100000:3.0:1789448378.145248:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358592 00000100:00100000:3.0:1789448378.145276:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789448378.145285:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317358336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.145344:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317358336:12345-0@lo:400:kworker.0 Request processed in 60us (7134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448378.145352:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789448378.145369:0:10266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789448378.145376:0:10266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317358592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.145421:0:10266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317358592:12345-0@lo:400:kworker.0 Request processed in 46us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448378.145427:0:10266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789448378.145444:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358464 00000100:00100000:3.0:1789448378.145448:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358464 00000100:00100000:3.0:1789448378.145473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789448378.145480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317358464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.145514:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317358464:12345-0@lo:400:kworker.0 Request processed in 35us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448378.145520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1789448378.145534:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448378.145538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448378.145540:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448378.145612:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317358464:0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.145643:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789448378.145649:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9eada0e00, transno 4294967322 00000004:00080000:3.0:1789448378.145662:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789448378.145678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317358592:0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.146082:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317358080:12345-0@lo:400:kworker.0 Request processed in 2679us (7871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448378.146091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789448378.146120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317357952 00000100:00100000:2.0:1789448378.146125:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317357952 00000100:00100000:2.0:1789448378.146151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789448378.146158:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317357952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448378.146189:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317357952:12345-0@lo:400:kworker.0 Request processed in 32us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448378.146196:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789448378.146311:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317358080:0@lo:400:kworker.0 00000100:00100000:3.0:1789448378.146322:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317357952:0@lo:400:kworker.0 00000100:00100000:1.0:1789448378.148370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448378.148448:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789448378.148455:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9fffadc00, transno 4294967310 00000100:00100000:1.0:1789448378.148477:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317358336:0@lo:400:kworker.0 00000100:00100000:1.0:1789448378.148506:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358208 00000100:00100000:1.0:1789448378.148512:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358208 00000100:00100000:1.0:1789448378.148565:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789448378.148573:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317358208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448378.148630:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317358208:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448378.148636:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1789448378.148655:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448378.148676:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317358208:0@lo:400:kworker.0 00010000:00010000:1.0:1789448378.521431:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448378.649636:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317358720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448378.649709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448378.649867:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358720 00000100:00100000:1.0:1789448378.649875:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358720 00000100:00100000:1.0:1789448378.649925:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789448378.649934:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317358720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448378.649968:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448378.650037:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eac8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317358720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448378.650045:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789448378.650377:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317358720:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789448379.099055:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448379.099067:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448379.099375:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789448379.099382:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789448379.162759:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317358848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448379.162827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448379.162905:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358848 00000100:00100000:0.0:1789448379.162912:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358848 00000100:00100000:0.0:1789448379.162952:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789448379.162961:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317358848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448379.162995:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448379.163038:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317358848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448379.163046:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789448379.163090:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317358848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789448379.547378:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448380.029381:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448380.029586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354240 00000100:00100000:3.0:1789448380.029597:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354240 00000100:00100000:3.0:1789448380.029680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:3.0:1789448380.029691:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11297:x1876372295354240:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789448380.029809:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11297:x1876372295354240:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 119us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448380.029816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00080000:1.0:1789448380.030155:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448380.039265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448380.044926:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354496 00000100:00100000:1.0:1789448380.044943:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354496 00000100:00100000:1.0:1789448380.045003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1789448380.045013:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:11297:x1876372295354496:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789448380.045443:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+19:11297:x1876372295354496:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 430us (6188us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789448380.045452:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1789448380.357661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448380.357704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448380.357748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448380.357783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448380.357813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355008 00000100:00100000:0.0:1789448380.357822:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355008 00000100:00100000:0.0:1789448380.357874:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:0.0:1789448380.357883:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295355008:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448380.357949:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+5:2348:x1876372295355008:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448380.357957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00080000:0.0:1789448380.357975:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448380.358587:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354880 00000100:00100000:3.0:1789448380.358595:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354880 00000100:00100000:3.0:1789448380.358640:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354752 00000100:00100000:3.0:1789448380.358644:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354752 00000100:00100000:3.0:1789448380.358668:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789448380.358676:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295354880:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448380.358732:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295354880:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 56us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448380.358738:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789448380.358752:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:3.0:1789448380.358758:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295354752:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448380.358780:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9fffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295354752:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448380.358785:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1789448380.359027:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295354624 00000100:00100000:2.0:1789448380.359032:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295354624 00000100:00100000:2.0:1789448380.359064:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:2.0:1789448380.359070:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295354624:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448380.359101:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295354624:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448380.359105:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00080000:0.0:1789448380.359614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448380.359619:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789448380.569872:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448381.593457:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448382.135138:0:12805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:59:40 (1789448380) 00000001:00080000:2.0:1789448382.277892:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789448382.277907:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789448382.277958:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789448382.277977:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789448382.623483:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448383.257636:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317359104:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.257705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448383.257765:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317359616:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.257787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448383.257822:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789448383.257827:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317358976:0@lo:400:kworker.0 00000100:00100000:3.0:1789448383.257930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359104 00000100:00100000:3.0:1789448383.257938:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359104 00000100:00100000:3.0:1789448383.257983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789448383.257991:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317359104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448383.258040:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317359104:12345-0@lo:400:kworker.0 Request processed in 50us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448383.258047:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789448383.258069:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359616 00000100:00100000:3.0:1789448383.258073:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359616 00000100:00100000:3.0:1789448383.258104:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789448383.258110:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448383.258147:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317359616:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448383.258153:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789448383.258248:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448383.258271:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317359488:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.258295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448383.258326:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317359104:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.258346:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317359616:0@lo:400:kworker.0 00000100:00100000:0.0:1789448383.258618:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317359360:0@lo:400:kworker.0 00000100:00100000:0.0:1789448383.258648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448383.258672:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448383.258676:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317359232:0@lo:400:kworker.0 00000100:00100000:0.0:1789448383.258690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789448383.258710:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448383.258721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359488 00000100:00100000:0.0:1789448383.258724:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359488 00000100:00100000:0.0:1789448383.258750:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359232 00000100:00100000:0.0:1789448383.258752:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359232 00000100:00100000:0.0:1789448383.258766:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789448383.258771:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317359488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448383.258807:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317359488:12345-0@lo:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448383.258813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789448383.258826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789448383.258934:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317358976 00000100:00100000:3.0:1789448383.258938:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317358976 00000100:00100000:3.0:1789448383.258961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789448383.258974:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317358976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448383.259005:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3307:x1876372317358976:12345-0@lo:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448383.259011:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789448383.259065:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317358976:0@lo:400:kworker.0 00000100:00100000:3.0:1789448383.259076:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317359488:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.259305:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359360 00000100:00100000:1.0:1789448383.259310:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359360 00000100:00100000:1.0:1789448383.259355:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789448383.259372:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317359360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.259422:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317359360:12345-0@lo:400:kworker.0 Request processed in 51us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448383.259428:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789448383.259460:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448383.259463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448383.259486:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317359360:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.260530:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317359232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.260808:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317359232:12345-0@lo:400:kworker.0 Request processed in 1968us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448383.260994:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317359232:0@lo:400:kworker.0 00000100:00100000:1.0:1789448383.261040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00010000:2.0:1789448383.644661:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448383.769531:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317359744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448383.769603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448383.769775:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359744 00000100:00100000:1.0:1789448383.769783:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359744 00000100:00100000:1.0:1789448383.769836:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789448383.769846:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317359744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448383.769879:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448383.769935:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317359744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448383.769942:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789448383.770020:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317359744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448384.282872:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448384.282894:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448384.282976:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448384.283049:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317359872 00000100:00100000:1.0:1789448384.283057:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317359872 00000100:00100000:1.0:1789448384.283106:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789448384.283114:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317359872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448384.283400:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448384.283622:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448384.283678:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317359872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448384.283686:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789448384.597167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448384.597258:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355136 00000100:00100000:3.0:1789448384.597268:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355136 00000100:00100000:3.0:1789448384.597408:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:3.0:1789448384.597420:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+5:12316:x1876372295355136:12345-192.168.202.54@tcp:101:lsof.0 00010000:00010000:3.0:1789448384.597452:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448384.597474:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f035 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.597539:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.597553:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.597567:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448384.597602:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789448384.597618:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448384.597661:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.597685:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27400/0xe29566c2465fa740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f035 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.598847:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f035 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448384.598859:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:3.0:1789448384.598862:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448384.598867:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27800, rc 0) 00000100:00100000:3.0:1789448384.598930:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30b293c1-5fe6-41b6-9c68-6199a552e486+6:12316:x1876372295355136:12345-192.168.202.54@tcp:101:lsof.0 Request processed in 1513us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448384.598938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00080000:1.0:1789448384.599635:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448384.669846:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448385.471106:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448385.471270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448385.471304:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448385.471323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448385.471376:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448385.471437:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355776 00000100:00100000:0.0:1789448385.471451:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355776 00000100:00100000:0.0:1789448385.471517:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355392 00000100:00100000:0.0:1789448385.471520:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355392 00000100:00100000:0.0:1789448385.471553:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:0.0:1789448385.471563:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2348:x1876372295355776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448385.472399:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355264 00000100:00100000:2.0:1789448385.472427:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355264 00000100:00100000:2.0:1789448385.472814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:2.0:1789448385.472826:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295355264:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448385.474089:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2348:x1876372295355776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 2513us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448385.474106:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:0.0:1789448385.474148:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:0.0:1789448385.474161:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+18:2348:x1876372295355392:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448385.474251:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+18:2348:x1876372295355392:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 95us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448385.474259:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00080000:0.0:1789448385.474294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448385.476160:0:10266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355520 00000100:00100000:1.0:1789448385.477695:0:10266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355520 00000100:00100000:1.0:1789448385.477822:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295355648 00000100:00100000:1.0:1789448385.477828:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295355648 00000100:00100000:1.0:1789448385.477861:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:1.0:1789448385.477871:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295355520:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448385.478353:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2348:x1876372295355520:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 469us (7068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448385.478362:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:1.0:1789448385.478381:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:1.0:1789448385.478389:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295355648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448385.478417:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2348:x1876372295355648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (7049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448385.478424:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00080000:0.0:1789448385.479001:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448385.479010:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448385.479127:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+13:2348:x1876372295355264:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 6292us (8025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448385.479143:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00010000:00010000:3.0:1789448385.689584:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448386.329965:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448386.330189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295356032 00000100:00100000:3.0:1789448386.330203:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295356032 00000100:00100000:3.0:1789448386.330299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1789448386.330314:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+18:12317:x1876372295356032:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1789448386.331843:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+19:12317:x1876372295356032:12345-192.168.202.54@tcp:35:umount.0 Request processed in 1521us (1886us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789448386.331880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1789448386.351584:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448386.352798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295356288 00000100:00100000:2.0:1789448386.352818:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295356288 00000100:00100000:2.0:1789448386.352907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1789448386.352930:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+19:12317:x1876372295356288:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:2.0:1789448386.353727:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7263448-abed-44d6-a5e0-4aa81ee22270+20:12317:x1876372295356288:12345-192.168.202.54@tcp:35:umount.0 Request processed in 804us (2153us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789448386.353738:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1789448386.365081:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448386.365264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295356544 00000100:00100000:3.0:1789448386.365279:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295356544 00000100:00100000:3.0:1789448386.365361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:3.0:1789448386.365375:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d2dee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+20:12317:x1876372295356544:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1789448386.365701:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d2dee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+21:12317:x1876372295356544:12345-192.168.202.54@tcp:35:umount.0 Request processed in 329us (634us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789448386.365710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789448386.370057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448386.370256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295356800 00000100:00100000:3.0:1789448386.370267:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295356800 00000100:00100000:3.0:1789448386.370323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1789448386.370345:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+21:12317:x1876372295356800:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1789448386.370716:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+22:12317:x1876372295356800:12345-192.168.202.54@tcp:35:umount.0 Request processed in 373us (668us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789448386.370723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:0.0:1789448386.376488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448386.376541:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448386.376623:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448386.376837:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295357056 00000100:00100000:1.0:1789448386.376860:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295357056 00000100:00100000:1.0:1789448386.376916:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295356928 00000100:00100000:1.0:1789448386.376919:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295356928 00000100:00100000:1.0:1789448386.376932:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295357184 00000100:00100000:1.0:1789448386.376934:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295357184 00000100:00100000:1.0:1789448386.376949:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789448386.376959:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+15:2350:x1876372295357056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448386.376986:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448386.377006:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58000/0xe29566c2465f9733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eb8f expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448386.377025:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448386.377080:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+14:2350:x1876372295357056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 122us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448386.377087:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789448386.377104:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789448386.377110:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+13:2350:x1876372295356928:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448386.377118:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448386.377128:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32200/0xe29566c2465f97cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebc7 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448386.377136:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448386.377155:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+12:2350:x1876372295356928:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 45us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448386.377161:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789448386.377202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789448386.377209:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+11:2350:x1876372295357184:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448386.377281:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448386.377291:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58200/0xe29566c2465f99b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec92 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448386.377300:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448386.377317:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b086e6-5128-47e9-ae2c-494c126c747d+10:2350:x1876372295357184:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 109us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448386.377323:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789448386.378778:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448386.381486:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295357568 00000100:00100000:3.0:1789448386.381502:0:12513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295357568 00000100:00100000:3.0:1789448386.381563:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1789448386.381574:0:12513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7263448-abed-44d6-a5e0-4aa81ee22270+7:2347:x1876372295357568:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:3.0:1789448386.381606:0:12513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9d06 00000020:00010000:3.0:1789448386.381615:0:12513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97d9fab6b000: total 0 00000100:00080000:3.0:1789448386.381620:0:12513:0:(import.c:65:import_set_state_nolock()) ffff97d9fab6f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448386.381719:0:12513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789448386.382037:0:12513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2347:x1876372295357568:12345-192.168.202.54@tcp:9:umount.0 Request processed in 463us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448386.382065:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000020:00010000:2.0:1789448386.383608:0:8432:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97d9fab6b000: total 0 00010000:00010000:1.0:1789448386.383741:0:8432:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97d9fab6b000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789448386.383871:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b98ac29/0xe29566c2465fa739 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f02e expref: 4 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448386.384060:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000779113/0xe29566c2465fa0a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee67 expref: 3 pid: 10266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448386.384079:0:8432:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97d9fab6b000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789448386.384094:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448386.384096:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448386.384098:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448386.390438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448386.390533:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295357696 00000100:00100000:2.0:1789448386.390544:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295357696 00000100:00100000:2.0:1789448386.390597:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:2.0:1789448386.390607:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+5:2347:x1876372295357696:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:2.0:1789448386.390649:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9aa5 00000100:00080000:2.0:1789448386.390659:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d9d1fc2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448386.390701:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1789448386.390788:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448386.391133:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7263448-abed-44d6-a5e0-4aa81ee22270+2:2347:x1876372295357696:12345-192.168.202.54@tcp:9:umount.0 Request processed in 525us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448386.391141:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:0.0:1789448386.400270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448386.400378:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295358720 00000100:00100000:2.0:1789448386.400389:0:7825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295358720 00000100:00100000:2.0:1789448386.400455:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:2.0:1789448386.400465:0:7825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+22:2347:x1876372295358720:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:2.0:1789448386.400506:0:7825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9741 00000020:00010000:2.0:1789448386.400526:0:7825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97d9fa810000: total 0 00000100:00080000:2.0:1789448386.400531:0:7825:0:(import.c:65:import_set_state_nolock()) ffff97d9fa812000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448386.400562:0:7825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1789448386.400797:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97d9fa810000: total 0 00010000:00010000:3.0:1789448386.400847:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97d9fa810000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789448386.400883:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448386.400887:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789448386.400905:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fa119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee83 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.400927:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448386.400929:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448386.400934:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32800/0xe29566c2465fa06a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee52 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.400949:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448386.400951:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448386.400955:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34e00/0xe29566c2465fa61a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533efe1 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.400977:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448386.400980:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789448386.400985:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26a00/0xe29566c2465f9d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ed8e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.400998:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9d6311100) 00010000:00010000:3.0:1789448386.401000:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448386.401004:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3800/0xe29566c2465f9a0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca0 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401044:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448386.401047:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789448386.401052:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fa094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee60 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401063:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448386.401065:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448386.401069:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34400/0xe29566c2465fa6fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f019 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401080:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97d9d6311e00) 00010000:00010000:3.0:1789448386.401082:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789448386.401086:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c1cc3e00/0xe29566c2465f9a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ecbc expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401100:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:3.0:1789448386.401103:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448386.401107:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27a00/0xe29566c2465fa0fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee7c expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401116:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97d9d6311000) 00010000:00010000:3.0:1789448386.401118:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789448386.401121:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26600/0xe29566c2465fa724 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f027 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401133:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97d9d0030700) 00010000:00010000:3.0:1789448386.401136:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448386.401145:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465f9f8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ee1a expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401160:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9e0bd6400) 00010000:00010000:3.0:1789448386.401162:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448386.401166:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9cae59800/0xe29566c2465f9a27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533eca7 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448386.401171:0:7825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7263448-abed-44d6-a5e0-4aa81ee22270+10:2347:x1876372295358720:12345-192.168.202.54@tcp:39:umount.0 Request processed in 707us (958us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789448386.401179:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00010000:00010000:3.0:1789448386.401180:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97d9d0030800) 00010000:00010000:3.0:1789448386.401182:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789448386.401185:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27200/0xe29566c2465fa3f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ef55 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448386.401196:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97d9fa810000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789448386.401209:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448386.401211:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448386.401213:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448386.713584:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448387.401183:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:1.0:1789448387.401194:0:7625:0:(genops.c:885:class_export_put()) final put ffff97d9fab6b000/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:1.0:1789448387.401265:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fab6b000/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-OST0001 00000020:00000080:1.0:1789448387.401335:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9fab6f000 for lustre-OST0001 00000001:00100000:2.0:1789448387.441710:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000001:00080000:2.0:1789448387.441736:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789448387.441840:0:5855:0:(genops.c:885:class_export_put()) final put ffff97d9fa810000/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:1.0:1789448387.441911:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fa810000/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-MDT0000 00000020:00000080:1.0:1789448387.442024:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9fa812000 for lustre-MDT0000 00010000:00010000:3.0:1789448387.738448:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448388.363089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448388.363143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448388.363185:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448388.363279:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295358848 00000100:00100000:1.0:1789448388.363374:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295358848 00000100:00100000:1.0:1789448388.363465:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295359104 00000100:00100000:1.0:1789448388.363469:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295359104 00000100:00100000:1.0:1789448388.363494:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295358976 00000100:00100000:1.0:1789448388.363498:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295358976 00000100:00100000:1.0:1789448388.363517:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1789448388.363529:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+12:2349:x1876372295358848:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448388.363549:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448388.363575:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32e00/0xe29566c2465f9813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebdc expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448388.363597:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448388.363664:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+11:2349:x1876372295358848:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 137us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448388.363672:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1789448388.363694:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448388.363701:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+10:2349:x1876372295359104:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448388.363710:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448388.363719:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc3600/0xe29566c2465f99b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec8b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448388.363731:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448388.363750:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+9:2349:x1876372295359104:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 49us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448388.363776:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448388.363789:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789448388.363795:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+8:2349:x1876372295358976:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448388.363803:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448388.363811:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2c00/0xe29566c2465f981a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ec06 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448388.363821:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448388.363840:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b086e6-5128-47e9-ae2c-494c126c747d+7:2349:x1876372295358976:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448388.363846:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789448388.371373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448388.371547:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295359360 00000100:00100000:0.0:1789448388.371562:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295359360 00000100:00100000:0.0:1789448388.371693:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:0.0:1789448388.371708:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+6:2347:x1876372295359360:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:0.0:1789448388.371769:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9828 00000020:00010000:0.0:1789448388.371778:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97d9ffe1d800: total 0 00000100:00080000:0.0:1789448388.371784:0:5835:0:(import.c:65:import_set_state_nolock()) ffff97d9ffe1a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789448388.371816:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1789448388.371909:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97d9ffe1d800: total 0 00010000:00010000:3.0:1789448388.371919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448388.372002:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97d9ffe1d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789448388.372057:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9d0a5c000) 00010000:00010000:3.0:1789448388.372062:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448388.372077:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27800/0xe29566c2465fa747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f035 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448388.372113:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97d9ffe1d800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789448388.372133:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448388.372136:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448388.372159:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448388.372400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448388.373085:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ce825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30b293c1-5fe6-41b6-9c68-6199a552e486+3:2347:x1876372295359360:12345-192.168.202.54@tcp:39:umount.0 Request processed in 1372us (1721us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789448388.373099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:3.0:1789448388.378514:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360384:0@lo:400:kworker.0 00000100:00100000:2.0:1789448388.378541:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317360256:0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.378604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448388.378677:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317360000:0@lo:400:kworker.0 00000100:00100000:1.0:1789448388.378750:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317360128:0@lo:400:kworker.0 00000100:00100000:2.0:1789448388.378799:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448388.378927:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360384 00000100:00100000:2.0:1789448388.378937:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360384 00000100:00100000:2.0:1789448388.379017:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789448388.379029:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448388.379096:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360384:12345-0@lo:400:kworker.0 Request processed in 69us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448388.379105:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1789448388.379168:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448388.379189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360256 00000100:00100000:2.0:1789448388.379193:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360256 00000100:00100000:2.0:1789448388.379262:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789448388.379270:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317360256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448388.379344:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317360256:12345-0@lo:400:kworker.0 Request processed in 75us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448388.379351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1789448388.379372:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448388.379416:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317360256:0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.379489:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360384:0@lo:400:kworker.0 00000100:00100000:0.0:1789448388.382275:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448388.382377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317360512:0@lo:400:kworker.0 00000100:00100000:0.0:1789448388.382507:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448388.382672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448388.382706:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317360640:0@lo:400:kworker.0 00000100:00100000:1.0:1789448388.382739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448388.382838:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360000 00000100:00100000:2.0:1789448388.382849:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360000 00000100:00100000:2.0:1789448388.382964:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789448388.382977:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317360000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448388.383102:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317360000:12345-0@lo:400:kworker.0 Request processed in 127us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448388.383111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789448388.383244:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360512 00000100:00100000:3.0:1789448388.383251:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360512 00000100:00100000:3.0:1789448388.383299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360128 00000100:00100000:3.0:1789448388.383303:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360128 00000100:00100000:3.0:1789448388.383335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789448388.383344:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317360512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.383386:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317360512:12345-0@lo:400:kworker.0 Request processed in 44us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448388.383393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789448388.383420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789448388.383427:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317360128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.383463:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317360128:12345-0@lo:400:kworker.0 Request processed in 37us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448388.383469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1789448388.383492:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448388.383509:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360640 00000100:00100000:3.0:1789448388.383513:0:12513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360640 00000100:00100000:3.0:1789448388.383547:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789448388.383553:0:12513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.383588:0:12513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eada0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317360640:12345-0@lo:400:kworker.0 Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448388.383594:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789448388.383608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789448388.383681:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317360128:0@lo:400:kworker.0 00000100:00100000:3.0:1789448388.383692:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317360640:0@lo:400:kworker.0 00000100:00100000:0.0:1789448388.383986:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317360000:0@lo:400:kworker.0 00000100:00100000:0.0:1789448388.383999:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317360512:0@lo:400:kworker.0 00000100:00100000:0.0:1789448388.439804:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448388.439947:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295359616 00000100:00100000:2.0:1789448388.439961:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295359616 00000100:00100000:2.0:1789448388.440035:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:2.0:1789448388.440049:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+7:2347:x1876372295359616:12345-192.168.202.54@tcp:251:umount.0 00000020:00000080:2.0:1789448388.440110:0:5826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f971e 00000020:00010000:2.0:1789448388.440385:0:5826:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97d9f56ce000: total 0 00000100:00080000:2.0:1789448388.440392:0:5826:0:(import.c:65:import_set_state_nolock()) ffff97d9f56c8000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789448388.440623:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:84b086e6-5128-47e9-ae2c-494c126c747d+3:2347:x1876372295359616:12345-192.168.202.54@tcp:251:umount.0 Request processed in 575us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448388.440634:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 306 00000020:00010000:1.0:1789448388.442491:0:8432:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97d9f56ce000: total 0 00010000:00010000:1.0:1789448388.442584:0:8432:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97d9f56ce000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789448388.442634:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae33e00/0xe29566c2465f97d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533ebce expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448388.442656:0:8432:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97d9f56ce000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789448388.442667:0:8432:0:(genops.c:885:class_export_put()) final put ffff97d9f56ce000/84b086e6-5128-47e9-ae2c-494c126c747d 00010000:00010000:1.0:1789448388.442757:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448388.442760:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448388.442787:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789448388.442974:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9f56ce000/84b086e6-5128-47e9-ae2c-494c126c747d for MGS 00000020:00000080:3.0:1789448388.443181:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9f56c8000 for MGS 00010000:00010000:3.0:1789448388.767431:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448388.891609:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448388.891644:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448388.891750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448388.892143:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360768 00000100:00100000:1.0:1789448388.892156:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360768 00000100:00100000:1.0:1789448388.892254:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789448388.892266:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448388.892326:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448388.892417:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448388.892426:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789448388.892595:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360768:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789448389.338506:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789448389.338521:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448389.338966:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789448389.338975:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789448389.403368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448389.403468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448389.403567:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317360896 00000100:00100000:1.0:1789448389.403579:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317360896 00000100:00100000:1.0:1789448389.403638:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789448389.403649:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448389.403699:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448389.403755:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317360896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448389.403770:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789448389.403832:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317360896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448389.786700:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789448390.425501:0:13003:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789448390.444464:0:13003:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789448390.444531:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.444551:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.444583:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.444590:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.444616:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789448390.444623:0:13003:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789448390.444657:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448390.444663:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789448390.444670:0:13003:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789448390.444703:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d9fb0ca800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789448390.444770:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317361024:0@lo:39:umount.0 00000100:00100000:2.0:1789448390.444861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448390.445029:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448390.445038:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445058:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448390.445061:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445071:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448390.445078:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448390.445084:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448390.445087:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789448390.445089:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789448390.445121:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445128:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448390.445154:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445161:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae58400/0xe29566c2465f97a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445176:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448390.445178:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448390.445179:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448390.445192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317361152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448390.445247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448390.445315:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361152 00000100:00100000:0.0:1789448390.445331:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361152 00000100:00100000:0.0:1789448390.445393:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448390.445404:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+19:3306:x1876372317361152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448390.445419:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448390.445436:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c1522e00/0xe29566c2465f97aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f97a3 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.445452:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448390.445491:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3306:x1876372317361152:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448390.445498:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448390.445545:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317361152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448390.445680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361024 00000100:00100000:3.0:1789448390.445686:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361024 00000100:00100000:3.0:1789448390.445765:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789448390.445773:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876372317361024:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789448390.445801:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f953b 00000100:00080000:3.0:1789448390.445812:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97d9fb0aa000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789448390.445906:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448390.446112:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1876372317361024:12345-0@lo:39:umount.0 Request processed in 339us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448390.446119:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789448390.446127:0:5834:0:(genops.c:885:class_export_put()) final put ffff97d9fb0ae800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789448390.446255:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9fb0ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789448390.446268:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317361024:0@lo:39:umount.0 00000100:00080000:1.0:1789448390.446362:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448390.446365:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789448390.446370:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789448390.449252:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449273:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449281:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449289:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449347:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448390.449354:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449360:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449366:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.449372:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449398:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448390.449414:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449426:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1522c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448390.449431:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449443:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448390.449473:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448390.449480:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448390.449483:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789448390.449533:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449540:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448390.449576:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449584:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1522c00/0xe29566c2465f97b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f97b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449606:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448390.449608:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448390.449609:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448390.449647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317361280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448390.449731:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448390.449808:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361280 00000100:00100000:3.0:1789448390.449816:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361280 00000100:00100000:3.0:1789448390.449887:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448390.449897:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+18:3307:x1876372317361280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448390.449913:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448390.449929:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59000/0xe29566c2465f97b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f97b1 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.449959:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448390.450000:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3307:x1876372317361280:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448390.450007:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448390.450068:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317361280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448390.450172:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448390.450182:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450190:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450196:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450202:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450214:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789448390.450245:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448390.450258:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450265:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a0600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448390.450269:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.450277:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448390.450285:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448390.451194:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789448390.451201:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789448390.451206:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789448390.451302:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451312:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448390.451345:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451353:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a0600/0xe29566c2465f96d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f96df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451479:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448390.451484:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451491:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2e00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448390.451504:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451513:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448390.451521:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448390.451527:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789448390.451530:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789448390.451534:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789448390.451568:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451574:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789448390.451592:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451601:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2e00/0xe29566c2465f99da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f99e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448390.451617:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448390.451619:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448390.451621:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448390.451642:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317361408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448390.451715:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448390.451780:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789448390.451851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0ae800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789448390.451948:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9fb0aa000 for lustre-MDT0000 00000100:00100000:0.0:1789448390.451979:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361408 00000100:00100000:0.0:1789448390.451989:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361408 00000100:00100000:0.0:1789448390.452048:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448390.452056:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eafd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+17:3304:x1876372317361408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448390.452070:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448390.452086:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465f96df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f96d8 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.452104:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448390.452156:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eafd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3304:x1876372317361408:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448390.452164:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789448390.452386:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448390.452398:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448390.452405:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448390.452412:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448390.452469:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448390.452474:0:13003:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789448390.452479:0:13003:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789448390.452531:0:13003:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789448390.452535:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789448390.452540:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448390.452547:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789448390.452552:0:13003:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97d9f56cd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448390.452558:0:13003:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97d9c86ca000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448390.452567:0:13003:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff97d9ffe1d800 30b293c1-5fe6-41b6-9c68-6199a552e486 192.168.202.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448390.452573:0:13003:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff97d9eada99c0) has exports, disconnecting them 00000020:00080000:2.0:1789448390.452578:0:13003:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97d9f56cd800), last request at 1789448388 00000020:00000080:2.0:1789448390.452586:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f96a0 00000100:00080000:2.0:1789448390.452605:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d9f56cf800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789448390.452692:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448390.452699:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.452708:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c1522000 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448390.452711:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.452720:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448390.452727:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448390.453184:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317361408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448390.453211:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448390.453234:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317361536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448390.453288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448390.456678:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361536 00000100:00100000:0.0:1789448390.456701:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361536 00000100:00100000:0.0:1789448390.456832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448390.456844:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+16:3304:x1876372317361536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448390.456867:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448390.456893:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2200/0xe29566c2465f99e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f99da expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.456914:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1789448390.457080:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448390.457083:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789448390.457087:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789448390.457129:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.457138:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448390.457164:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.457181:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c1522000/0xe29566c2465f948c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f9493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448390.457203:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448390.457206:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448390.457209:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448390.457247:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317361664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448390.459857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448390.463029:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3304:x1876372317361536:12345-0@lo:103:ldlm_bl.0 Request processed in 6167us (9719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448390.463041:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3304:1876372317361536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448390.463054:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448390.463101:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361664 00000100:00100000:0.0:1789448390.463113:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361664 00000100:00100000:0.0:1789448390.463198:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789448390.463209:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+15:3306:x1876372317361664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448390.463256:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448390.463283:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9c0031400/0xe29566c2465f9493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f948c expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448390.463318:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448390.463406:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7fbad7-cbfc-4005-a352-7f3edcab574e+14:3306:x1876372317361664:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448390.463413:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789448390.463529:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317361664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448390.467704:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789448390.468084:0:13003:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d9f56cd800): rc 0 00000020:00000080:2.0:1789448390.468091:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9f56cd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789448390.470782:0:13003:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97d9c86ca000), last request at 1789448388 00000020:00000080:2.0:1789448390.470797:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f95d5 00000100:00080000:2.0:1789448390.470814:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d9c86cd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789448390.470849:0:13003:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d9c86ca000): rc 0 00000020:00000080:2.0:1789448390.470851:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9c86ca000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1789448390.470893:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789448390.477988:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9f56cd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789448390.478758:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9f56cf800 for lustre-MDT0000 00000004:00000080:2.0:1789448390.478870:0:13003:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8ae817f3ae0 00000100:00080000:2.0:1789448390.478907:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789448390.478914:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789448390.478937:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789448390.479001:0:13003:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789448390.479038:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d8c1955000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789448390.479061:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789448390.479064:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789448390.479074:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789448390.479170:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317361792:0@lo:9:umount.0 00000100:00100000:2.0:1789448390.479303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448390.479371:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361792 00000100:00100000:2.0:1789448390.479382:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361792 00000100:00100000:2.0:1789448390.479449:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789448390.479460:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876372317361792:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789448390.479491:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9622 00000100:00080000:2.0:1789448390.479503:0:6672:0:(import.c:65:import_set_state_nolock()) ffff97d8c1957000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448390.479548:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789448390.479943:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1876372317361792:12345-0@lo:9:umount.0 Request processed in 483us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448390.479952:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789448390.480005:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d8c1955000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789448390.480011:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789448390.480033:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789448390.480038:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317361792:0@lo:9:umount.0 00000100:00080000:2.0:1789448390.480062:0:13003:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789448390.480077:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d9e7a71000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789448390.480099:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317361920:0@lo:9:umount.0 00000100:00100000:2.0:1789448390.480131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448390.480164:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317361920 00000100:00100000:2.0:1789448390.480168:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317361920 00000100:00080000:3.0:1789448390.480749:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789448390.480766:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c86ca000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789448390.480823:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9c86cd800 for lustre-MDT0000 00010000:00010000:3.0:1789448390.480838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789448390.481019:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff97d9eada99c0) has no exports 00000100:00100000:2.0:1789448390.482381:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789448390.482396:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876372317361920:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789448390.482437:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9709 00000100:00080000:2.0:1789448390.482450:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97d9fad28800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448390.482500:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1789448390.483926:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448390.484938:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1876372317361920:12345-0@lo:9:umount.0 Request processed in 2535us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448390.484955:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789448390.484996:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448390.486544:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9e7a71000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789448390.486577:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789448390.486580:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789448390.486588:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317361920:0@lo:9:umount.0 00000020:00080000:3.0:1789448390.493665:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff97d9eada99c0) has no exports 00000020:00000080:3.0:1789448390.570724:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94e7 00000020:00000080:3.0:1789448390.570741:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9f4fcb000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789448390.570765:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789448390.570823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9f4fcb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789448390.570852:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448390.570865:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789448390.570871:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff97d9eaf60000) has no exports 00000020:00000080:0.0:1789448390.571303:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94e0 00000020:00000080:0.0:1789448390.571312:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9d2e61800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448390.571357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d2e61800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789448390.571377:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448390.571386:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789448390.571410:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9d2df0000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789448390.571412:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d2df0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789448390.571422:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1789448390.810439:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789448391.562426:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789448391.562436:0:6696:0:(genops.c:885:class_export_put()) final put ffff97d8c1954800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789448391.562463:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:2.0:1789448391.562466:0:6696:0:(genops.c:885:class_export_put()) final put ffff97d9d1fc0800/a7263448-abed-44d6-a5e0-4aa81ee22270 00000020:00000080:0.0:1789448391.563087:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1954800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789448391.563150:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d1fc0800/a7263448-abed-44d6-a5e0-4aa81ee22270 for lustre-OST0000 00000020:00000080:0.0:1789448391.563173:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d8c1957000 for lustre-OST0000 00000020:00000080:0.0:1789448391.563179:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9d1fc2000 for lustre-OST0000 00010000:00010000:3.0:1789448391.835408:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448392.558617:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448392.558627:0:7625:0:(genops.c:885:class_export_put()) final put ffff97d9fad2f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789448392.558800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fad2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789448392.558851:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9fad28800 for lustre-OST0001 00000001:00100000:2.0:1789448392.568463:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30b293c1-5fe6-41b6-9c68-6199a552e486 00000001:00080000:2.0:1789448392.568481:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789448392.568488:0:5855:0:(genops.c:885:class_export_put()) final put ffff97d9ffe1d800/30b293c1-5fe6-41b6-9c68-6199a552e486 00000020:00000080:0.0:1789448392.568560:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9ffe1d800/30b293c1-5fe6-41b6-9c68-6199a552e486 for lustre-MDT0000 00000020:00000080:0.0:1789448392.568619:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9ffe1a000 for lustre-MDT0000 00000020:01000000:0.0:1789448392.601370:0:13003:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9d26d66c0 - data ffff97d9f50036c0/ffff97d9fa6de800 00000020:01000000:0.0:1789448392.601849:0:13003:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9c66bfb40 - data ffff97d9ecf73d80/ffff97d9d2ef5400 00000001:00000004:3.0:1789448392.614070:0:13003:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1789448392.701104:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789448392.701125:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789448392.701147:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448392.701150:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789448392.701819:0:6762:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789448392.701823:0:6762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789448392.701835:0:6762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789448392.703814:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789448392.703830:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789448392.703851:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448392.703854:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789448392.704119:0:7858:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789448392.704124:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789448392.704145:0:7858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789448392.784823:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94af 00000020:00000080:1.0:1789448392.784835:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0c9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789448392.785791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789448392.786404:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94c4 00000020:00000080:1.0:1789448392.786411:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0ca000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789448392.786424:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789448392.786429:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.786436:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789448392.786440:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff97d9eadacd40) has no exports 00000020:00000080:0.0:1789448392.786591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0ca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789448392.786730:0:13003:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789448392.786739:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9702 00000020:00000080:1.0:1789448392.786744:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fa816800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789448392.786828:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789448392.786832:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.786839:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789448392.786842:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff97d9ceaab380) has no exports 00000020:00000080:1.0:1789448392.786856:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f96fb 00000020:00000080:1.0:1789448392.786861:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9e7a71800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789448392.787205:0:13003:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789448392.787210:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789448392.787239:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789448392.787245:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789448392.787247:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448392.787285:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.787292:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789448392.787389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fa816800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789448392.787397:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9e7a71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789448392.787402:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9e7a71000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789448392.787409:0:37:0:(genops.c:885:class_export_put()) final put ffff97d8c1954000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789448392.787412:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1954000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789448392.787416:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448392.787824:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f961b 00000020:00000080:1.0:1789448392.787831:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d8c1225000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789448392.787846:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789448392.787851:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.787857:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789448392.787859:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff97d9ceaa99c0) has no exports 00000020:00000080:1.0:1789448392.787864:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9614 00000020:00000080:1.0:1789448392.787868:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d8c1951800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789448392.788178:0:13003:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789448392.788181:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789448392.788184:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789448392.788189:0:13003:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789448392.788190:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448392.788213:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.788245:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789448392.788865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1225000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789448392.788875:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1951800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789448392.788880:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d8c1955000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789448392.788898:0:37:0:(genops.c:885:class_export_put()) final put ffff97d8c1952000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789448392.788900:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1952000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789448392.788905:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448392.789536:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.789544:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448392.789547:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9ce94a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448392.789550:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9ce94a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789448392.789613:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448392.789728:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94cb 00000020:00000080:1.0:1789448392.789734:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0cb800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789448392.790333:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789448392.790340:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.790346:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789448392.790349:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff97d9eadab380) has no exports 00000020:00000080:1.0:1789448392.790373:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.790377:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789448392.790381:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f94d2 00000020:00000080:1.0:1789448392.790386:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0c8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789448392.793405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0cb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789448392.793418:0:37:0:(genops.c:885:class_export_put()) final put ffff97d9fb0cd000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789448392.793421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0cd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789448392.793428:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789448392.795394:0:13003:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9c6cee800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789448392.795402:0:13003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c6cee800 3 00000020:01000004:1.0:1789448392.795405:0:13003:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97d9c6cee800 from lustre-MDT0000 00000020:00000080:1.0:1789448392.795431:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.795440:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789448392.795445:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0cc800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789448392.795447:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0cc800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789448392.795456:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1789448392.795635:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789448392.795685:0:13003:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789448392.795691:0:13003:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789448392.795695:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789448392.795700:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.795704:0:13003:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789448392.795711:0:13003:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff97d9eadb6800 8c7fbad7-cbfc-4005-a352-7f3edcab574e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789448392.795718:0:13003:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff97d9eaf619c0) has exports, disconnecting them 00000020:00080000:1.0:1789448392.795723:0:13003:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97d9eadb6800), last request at 1789448153 00000020:00000080:1.0:1789448392.795739:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9470 00000020:00010000:1.0:1789448392.795745:0:13003:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97d9eadb6800: total 0 00000100:00080000:1.0:1789448392.796383:0:13003:0:(import.c:65:import_set_state_nolock()) ffff97d9eadb4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789448392.796409:0:13003:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d9eadb6800): rc 0 00000020:00080000:1.0:1789448392.796414:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff97d9eaf619c0) has no exports 00000020:00010000:3.0:1789448392.796567:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97d9eadb6800: total 0 00010000:00010000:3.0:1789448392.796607:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97d9eadb6800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789448392.796648:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae58c00/0xe29566c2465f9588 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f9581 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796672:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9cae59600/0xe29566c2465f97c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f97bf expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796683:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2000/0xe29566c2465f99c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f99be expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796693:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fad26c00/0xe29566c2465f99d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f99cc expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796707:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2400/0xe29566c2465f9772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f976b expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796718:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32400/0xe29566c2465f978e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f9787 expref: 4 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796728:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc3000/0xe29566c2465f9780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f9779 expref: 3 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32a00/0xe29566c2465f979c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe29566c2465f9795 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448392.796753:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97d9eadb6800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789448392.796765:0:5822:0:(genops.c:885:class_export_put()) final put ffff97d9eadb6800/8c7fbad7-cbfc-4005-a352-7f3edcab574e 00010000:00010000:3.0:1789448392.796777:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448392.796792:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448392.796794:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789448392.796801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9eadb6800/8c7fbad7-cbfc-4005-a352-7f3edcab574e for MGS 00000100:00100000:1.0:1789448392.796818:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff97d9eacd9000:5827] 1 exiting: rc = 0 00000020:00000080:3.0:1789448392.796831:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9eadb4000 for MGS 00000100:00100000:0.0:1789448392.796990:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff97d9eacd8400:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1789448392.802177:0:5826:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff97d9d2ad9400:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1789448392.802338:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802347:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802368:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802375:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802380:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802386:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802392:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802398:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802404:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802409:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802415:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802425:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802430:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802436:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802442:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802447:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802452:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802457:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802463:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802469:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802474:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802493:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802500:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802506:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802510:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802515:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802520:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802525:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802531:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802536:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802541:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802547:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802552:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802567:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802573:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802579:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802584:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802597:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802603:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802608:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802613:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802618:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802623:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802628:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802634:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802639:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802644:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802649:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802655:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802660:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802665:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802670:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802676:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802681:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802686:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802691:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802696:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802701:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802706:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802712:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802717:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802722:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802727:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.802733:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789448392.803907:0:13003:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789448392.803912:0:13003:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789448392.820331:0:13003:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9fff52120 - data ffff97d9f51ba948/ffff97d9fa5bbc00 00000020:01000000:1.0:1789448392.820469:0:13003:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9d0c465a0 - data ffff97d9e3c3eca8/ffff97d9d19f4000 00000020:00000080:1.0:1789448392.821201:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9454 00000020:00000080:1.0:1789448392.821209:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9c840d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789448392.821244:0:13003:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9c6cee800 from MGS, refs=2 00000020:01000004:1.0:1789448392.821258:0:13003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c6cee800 2 00000020:01000004:1.0:1789448392.821262:0:13003:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97d9c6cee800 from MGS 00000020:00000080:1.0:1789448392.821294:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.821301:0:13003:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789448392.821304:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9c61a9000/MGS 00000020:00000080:1.0:1789448392.821307:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c61a9000/MGS for MGS 00000020:01000000:1.0:1789448392.821313:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789448392.821367:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789448392.821371:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.821376:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789448392.821383:0:13003:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97d9fb0ce800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789448392.821388:0:13003:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff97d9f4940000) has exports, disconnecting them 00000020:00080000:1.0:1789448392.821393:0:13003:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97d9fb0ce800), last request at 1789448154 00000020:00000080:1.0:1789448392.821397:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f951f 00000020:00080000:1.0:1789448392.821406:0:13003:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d9fb0ce800): rc 0 00000020:00000080:1.0:1789448392.821411:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9fb0ce800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789448392.821705:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c840d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789448392.821714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0ce800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789448392.825865:0:13003:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789448392.825874:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789448392.825878:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789448392.825884:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789448392.826053:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448392.826062:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789448392.826068:0:13003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c6cee800 1 00000020:00000080:0.0:1789448392.826075:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9446 00000020:00000080:0.0:1789448392.826083:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9d0919000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789448392.826088:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789448392.826093:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448392.826098:0:13003:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789448392.826102:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff97d9eaf64d40) has no exports 00000020:00000080:3.0:1789448392.826183:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9fb0ca800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789448392.826191:0:36:0:(genops.c:885:class_export_put()) final put ffff97d9d2e65000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789448392.826194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d2e65000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789448392.826199:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789448392.826284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d0919000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789448392.862168:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789448392.900421:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.900435:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789448392.900440:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9c6cec800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448392.900444:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c6cec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789448392.900451:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789448392.900741:0:13003:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97d9c6ce9800 00000020:01000000:1.0:1789448392.900758:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789448392.900762:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448392.900766:0:13003:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448392.900770:0:13003:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff97d9eada8000) has no exports 00000100:00100000:0.0:1789448392.900922:0:5833:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff97d9ead94000:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1789448392.901007:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff97d9ead95000:5835] 2 exiting: rc = 0 00000100:00100000:0.0:1789448392.901385:0:7825:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff97da01c57200:7825] 3 exiting: rc = 0 00000100:00100000:3.0:1789448392.904755:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff97d9ead94800:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789448392.904934:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904943:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904949:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904955:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904961:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904977:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904982:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904987:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904992:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.904998:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905003:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905008:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905013:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905021:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905027:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905033:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905039:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905044:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905051:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905057:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905061:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905067:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905072:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905076:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905082:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905086:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905091:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905096:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905101:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905106:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905112:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905118:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905123:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905129:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905135:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905140:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905145:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905151:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905156:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905162:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905175:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905180:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905186:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905191:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905197:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905202:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905207:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905212:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905237:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905244:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905249:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905254:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905259:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905264:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905280:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905286:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905292:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905298:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905304:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905309:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905315:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905321:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905328:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.905334:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.909196:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97d9eacd9e00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1789448392.909767:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97d9ead93a00:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1789448392.909920:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909930:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909939:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909945:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909951:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909958:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909964:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909969:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909975:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909980:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.909986:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910003:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910010:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910015:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910020:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910026:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910031:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910036:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910040:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910045:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910049:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910054:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910058:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910063:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910069:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910073:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910078:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910082:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910086:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910090:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910095:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910100:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910104:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910108:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910114:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910119:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910123:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910129:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910134:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910140:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910145:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910150:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910155:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910160:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910165:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910170:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910183:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910187:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910192:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910197:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910202:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910207:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910212:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910236:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910242:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910247:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910252:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910258:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910263:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910277:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910283:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910288:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910293:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.910299:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448392.911000:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff97d9d19e7a00:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1789448392.911089:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff97d9c605b400:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1789448392.911155:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911162:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911176:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911183:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911189:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911195:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911201:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911207:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911212:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911236:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911242:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911259:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911266:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911282:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911288:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911295:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911300:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911315:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911321:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911327:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911332:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911338:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911343:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911362:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911369:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911374:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911380:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911386:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911393:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911400:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911406:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911412:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911418:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911424:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911430:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911450:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911457:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911463:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911470:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911476:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911549:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911555:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911560:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911567:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911572:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911578:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911584:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911604:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911610:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911616:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911622:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911627:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911642:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911648:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911654:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911661:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911666:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911671:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911677:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911697:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911704:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911712:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911719:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.911725:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.919040:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97d9c605b600:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1789448392.919214:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97d9c605bc00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789448392.919304:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919314:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919321:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919339:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919346:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919353:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919360:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919367:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919375:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919383:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919390:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919398:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919404:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919412:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919418:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919422:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919428:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919433:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919439:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919444:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919448:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919456:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919464:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919477:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919486:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919490:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919493:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919497:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919500:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919503:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919506:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919510:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919515:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919519:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919525:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919529:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919534:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919539:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919549:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919554:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919559:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919564:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919569:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919574:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919579:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919584:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919589:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919593:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919598:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919603:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919607:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919613:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919619:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919626:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919630:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919635:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919639:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919643:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919648:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919653:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919658:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919663:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919668:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.919673:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.919964:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97d9c605be00:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1789448392.920062:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97d9c605aa00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1789448392.920158:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920164:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920169:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920174:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920180:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920185:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920190:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920194:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920200:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920211:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920235:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920328:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920337:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920345:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920353:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920361:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920365:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920373:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920376:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920379:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920383:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920386:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920389:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920392:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920397:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920401:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920405:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920409:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920413:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920417:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920421:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920425:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920429:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920433:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920437:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920441:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920446:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920451:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920456:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920461:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920527:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920535:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920545:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920555:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920572:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920578:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920583:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920587:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920593:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920600:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920607:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920613:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920619:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920626:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920631:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920635:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920639:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920643:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920647:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920652:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920656:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920660:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920664:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.920668:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448392.921264:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff97d9c605b200:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1789448392.921264:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff97d9c605b800:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1789448392.921580:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921585:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921590:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921595:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921599:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921603:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921608:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921612:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921618:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921624:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921630:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921634:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921638:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921643:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921649:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921663:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921669:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921674:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921680:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921683:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921687:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921690:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921693:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921696:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921699:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921702:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921705:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921707:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921711:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921715:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921721:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921725:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921729:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921733:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921737:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921742:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921747:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921754:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921760:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921767:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921774:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921782:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921792:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921801:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921809:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921817:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921822:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921825:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921830:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921834:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921847:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921851:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921854:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921857:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921861:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921864:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921867:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921871:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921875:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921879:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921884:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921888:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921892:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.921896:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448392.922846:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff97d9c605ae00:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1789448392.922931:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff97d9c605a200:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1789448392.922980:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff97d9c605a000:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1789448392.923023:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923030:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923035:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923040:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923046:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923051:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923055:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923061:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923066:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923071:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923076:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923094:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923100:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923104:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923109:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923115:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923119:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923123:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923129:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923133:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923138:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923151:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923157:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923163:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923173:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923180:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923189:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923196:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923204:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923208:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923211:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923238:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923348:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923353:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923359:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923381:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923387:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923392:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923397:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923402:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923406:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923411:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923414:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923418:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923422:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923426:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923430:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923435:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923440:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923443:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923448:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923452:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923456:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923463:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923543:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923548:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923558:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923563:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923568:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923573:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923578:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923583:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923589:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448392.923594:0:13003:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789448392.928019:0:13003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448392.928028:0:13003:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789448392.928031:0:13003:0:(genops.c:885:class_export_put()) final put ffff97d9d2e63000/MDS_uuid 00000020:00000080:1.0:1789448392.928035:0:13003:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d2e63000/MDS_uuid for MDS 00000020:01000000:1.0:1789448392.928039:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789448392.928134:0:13003:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1789448393.501144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317362048:0@lo:400:kworker.0 00000400:00000100:3.0:1789448393.501200:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876372317362048 offset 0 length 224: 4 00000100:00100000:0.0:1789448393.501286:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317362176:0@lo:400:kworker.0 00000400:00000100:0.0:1789448393.501313:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317362176 offset 0 length 224: 4 00000100:00100000:0.0:1789448393.501332:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448393.501337:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317362304:0@lo:400:kworker.0 00000400:00000100:0.0:1789448393.501352:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317362304 offset 0 length 224: 4 00010000:00010000:1.0:1789448393.882652:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448394.907102:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789448395.513570:0:13155:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789448395.522726:0:13155:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789448395.522775:0:13155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448395.522788:0:13155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448395.522795:0:13155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448395.522802:0:13155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448395.522856:0:13155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448395.522862:0:13155:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789448395.522884:0:13155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448395.522896:0:13155:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9f54c7800 x1876372317362176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448395.522910:0:13155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789448395.522916:0:13155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789448395.522940:0:13155:0:(import.c:65:import_set_state_nolock()) ffff97d9c86c8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789448395.522983:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448395.522991:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448395.522999:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448395.523003:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448395.523012:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448395.523019:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448395.523026:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448395.523028:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789448395.523037:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789448395.523062:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448395.523068:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789448395.523117:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317362560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448395.523181:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448395.523294:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448395.523302:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae59c00/0xe29566c2465f9787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe29566c2465f978e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448395.523314:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448395.523316:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448395.523318:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448395.523340:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317362176:0@lo:400:kworker.0 00000100:00100000:0.0:1789448395.524297:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317362432:0@lo:39:umount.0 00000400:00000100:0.0:1789448395.524330:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317362432 offset 0 length 224: 4 00000100:00100000:1.0:1789448395.528001:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317362560 00000100:00100000:1.0:1789448395.528014:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317362560 00000100:00100000:1.0:1789448395.528060:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789448395.528068:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1876372317362560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789448395.528075:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448395 with bad export cookie 16327069008691958896 00000100:00100000:0.0:1789448395.538241:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1876372317362560:12345-0@lo:103:ldlm_bl.0 Request processed in 10137us (15023us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789448395.538267:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789448395.538805:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789448395.538812:0:3306:0:(import.c:65:import_set_state_nolock()) ffff97d9ce94d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789448395.538815:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789448395.544205:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789448395.544212:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789448395.544446:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9f54c5180 x1876372317362048/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789448409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448395.544494:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9f54c6300 x1876372317362560/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448411 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789448395.544504:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789448395.544507:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789448395.544508:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789448395.544512:0:3306:0:(import.c:65:import_set_state_nolock()) ffff97d9ce94d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448395.544517:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 175 00000100:00080000:2.0:1789448395.544532:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff97d9ce94d000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789448395.544619:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54c7800 x1876372317362688/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789448395.544664:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3306:1876372317362560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448395.544729:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3307:1876372317362048:0@lo:400:kworker.0 00000100:00100000:2.0:1789448395.544789:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317362688:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1789448395.544835:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876372317362688 offset 0 length 520: 4 00010000:00010000:3.0:1789448395.929533:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448396.953647:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448397.977435:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789448398.619408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789448398.619417:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448398.619943:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317362816:0@lo:400:kworker.0 00000400:00000100:3.0:1789448398.619999:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317362816 offset 0 length 224: 4 00010000:00010000:3.0:1789448399.001499:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448400.026331:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448400.666960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448400.666970:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789448400.667066:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317362944:0@lo:400:kworker.0 00000400:00000100:0.0:1789448400.667140:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317362944 offset 0 length 224: 4 00010000:00010000:0.0:1789448401.051707:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448402.076385:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448403.099850:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448404.121415:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448405.145675:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448405.786551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448405.786561:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448405.786781:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448405.786802:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317363072:0@lo:400:kworker.0 00000400:00000100:3.0:1789448405.786856:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317363072 offset 0 length 224: 4 00000100:00100000:3.0:1789448405.792341:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448395/real 1789448395] req@ffff97d9f54c7800 x1876372317362688/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448405.792374:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9f54c7800 x1876372317362688/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448405.792401:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448395/real 1789448395] req@ffff97d9d138ca80 x1876372317362432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448405.792414:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9d138ca80 x1876372317362432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448405.792432:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9ce94d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448405.792455:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789448405.792459:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317362688:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789448405.792464:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9c86c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789448405.792478:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317362432:0@lo:39:umount.0 00000100:00080000:1.0:1789448405.792559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448405.792565:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789448405.792568:0:37:0:(import.c:65:import_set_state_nolock()) ffff97d9ce94d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448405.792586:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789448405.792591:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789448405.792601:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff97d9ce94d000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448405.792631:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fd8a80 x1876372317363200/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789448405.792857:0:13155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448405.792862:0:13155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789448405.792867:0:13155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789448405.794425:0:13155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794442:0:13155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794449:0:13155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794456:0:13155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794471:0:13155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448405.794477:0:13155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794502:0:13155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794508:0:13155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794514:0:13155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448405.794539:0:13155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789448405.794543:0:13155:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789448405.794568:0:13155:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000100:00100000:3.0:1789448405.794721:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317363200:0@lo:250:kworker.0 00000400:00000100:3.0:1789448405.794779:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876372317363200 offset 0 length 520: 4 00010000:00010000:1.0:1789448405.795171:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448405.795179:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795188:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae58800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448405.795191:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795201:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448405.795208:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448405.795214:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789448405.795237:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789448405.795240:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789448405.795253:0:8432:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:1.0:1789448405.795267:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795274:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae58800/0xe29566c2465f9795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f979c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795289:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448405.795292:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795297:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:1.0:1789448405.795301:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795307:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448405.795313:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448405.795319:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789448405.795321:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789448405.795323:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789448405.795327:0:8432:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:1.0:1789448405.795330:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795336:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3c00/0xe29566c2465f99cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f99d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448405.795346:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448405.795354:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448405.795356:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789448405.795411:0:13155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789448405.795417:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448405.795424:0:13155:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789448405.795428:0:13155:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff97d9f4944d40) has no exports 00000020:00080000:2.0:1789448405.795475:0:13155:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff97d9f4944d40) has no exports 00010000:00010000:0.0:1789448405.796304:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789448405.804874:0:13155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9fff52060 - data ffff97d9ecf50af8/ffff97d9d1054400 00000020:01000000:2.0:1789448405.805036:0:13155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9eaf378a0 - data ffff97d9ecff1360/ffff97d9c6699000 00100000:10000000:2.0:1789448405.826899:0:13155:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789448405.880674:0:13155:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f95a4 00000020:00000080:2.0:1789448405.880685:0:13155:0:(genops.c:885:class_export_put()) final put ffff97d8c1223800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789448405.880707:0:13155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9c336e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789448405.880710:0:13155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c336e800 2 00000020:01000004:2.0:1789448405.880713:0:13155:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97d9c336e800 from lustre-OST0000 00000020:00000080:2.0:1789448405.880750:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448405.880769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1223800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789448405.880800:0:13155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789448405.880803:0:13155:0:(genops.c:885:class_export_put()) final put ffff97d8c1226800/lustre-OST0000_UUID 00000020:00000080:2.0:1789448405.880806:0:13155:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1226800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789448405.880825:0:13155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789448405.880870:0:13155:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789448405.880875:0:13155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789448405.880879:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448405.880899:0:13155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789448405.880924:0:13155:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97d8c1221800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448405.880930:0:13155:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff97d8c196cd40) has exports, disconnecting them 00000020:00080000:2.0:1789448405.880935:0:13155:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97d8c1221800), last request at 1789448172 00000020:00000080:2.0:1789448405.880938:0:13155:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f95ce 00000020:00080000:2.0:1789448405.880947:0:13155:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d8c1221800): rc 0 00000020:00000080:2.0:1789448405.880955:0:13155:0:(genops.c:885:class_export_put()) final put ffff97d8c1221800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789448405.881000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1221800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789448405.920839:0:13155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789448405.920847:0:13155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448405.920851:0:13155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789448405.920858:0:13155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448405.921077:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448405.921088:0:13155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789448405.921094:0:13155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9c336e800 1 00000020:00000080:1.0:1789448405.921101:0:13155:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f955e 00000020:00000080:1.0:1789448405.921110:0:13155:0:(genops.c:885:class_export_put()) final put ffff97d9c3368000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789448405.921137:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9c86c8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789448405.921144:0:37:0:(genops.c:885:class_export_put()) final put ffff97d9c86cc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789448405.921147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c86cc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789448405.921165:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789448405.921394:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c3368000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789448405.921467:0:13155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789448405.921471:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448405.921476:0:13155:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448405.921480:0:13155:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff97d9ceaa8000) has no exports 00000020:00000080:1.0:1789448405.951132:0:13155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448405.951164:0:13155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789448405.951169:0:13155:0:(genops.c:885:class_export_put()) final put ffff97d9c336d000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789448405.951174:0:13155:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c336d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789448405.951184:0:13155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789448405.951625:0:13155:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97d9c336a800 00000020:02000400:1.0:1789448405.951667:0:13155:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789448406.172254:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448407.195364:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448408.217364:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789448408.625735:0:13307:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789448408.641411:0:13307:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789448408.641491:0:13307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448408.641504:0:13307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448408.641525:0:13307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448408.641532:0:13307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448408.641556:0:13307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789448408.641562:0:13307:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789448408.641586:0:13307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789448408.641597:0:13307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9f54c4000 x1876372317362304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448408.641618:0:13307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9f54c6300 x1876372317362816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448414 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448408.641633:0:13307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9c7fd9180 x1876372317362944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448408.641641:0:13307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9c7fdaa00 x1876372317363072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448408.641648:0:13307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789448408.641654:0:13307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789448408.641678:0:13307:0:(import.c:65:import_set_state_nolock()) ffff97d9f56c8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789448408.641711:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317363328:0@lo:39:umount.0 00000400:00000100:3.0:1789448408.641763:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876372317363328 offset 0 length 224: 4 00000100:00100000:1.0:1789448408.641920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317363072:0@lo:400:kworker.0 00000100:00100000:1.0:1789448408.641930:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317362944:0@lo:400:kworker.0 00000100:00100000:1.0:1789448408.641937:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876372317362304:0@lo:400:kworker.0 00010000:00010000:0.0:1789448408.642111:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448408.642119:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448408.642139:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448408.642142:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448408.642150:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448408.642158:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448408.642163:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448408.642166:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789448408.642168:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789448408.642181:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:0.0:1789448408.642185:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448408.642205:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae33c00/0xe29566c2465f976b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f9772 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448408.642241:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448408.642244:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448408.642246:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448408.642485:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317362816:0@lo:400:kworker.0 00010000:00010000:1.0:1789448409.241547:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448410.265380:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448410.905679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448410.905691:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789448411.289333:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448412.313678:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448413.337441:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448414.362284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448415.385597:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789448416.026396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789448416.026412:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789448416.409443:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448417.433556:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448418.457820:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448418.841392:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448408/real 1789448408] req@ffff97d9f54bb800 x1876372317363328/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448418.841436:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9f54bb800 x1876372317363328/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448418.841486:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9f56c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789448418.841515:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317363328:0@lo:39:umount.0 00000100:00080000:2.0:1789448418.842499:0:13307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448418.842506:0:13307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789448418.842512:0:13307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789448418.843442:0:13307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843459:0:13307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843465:0:13307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843484:0:13307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843504:0:13307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448418.843511:0:13307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843515:0:13307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843520:0:13307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843523:0:13307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.843536:0:13307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789448418.843538:0:13307:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789448418.843563:0:13307:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789448418.843568:0:13307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789448418.843571:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448418.843577:0:13307:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789448418.843581:0:13307:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff97d9f49419c0) has no exports 00000020:00080000:2.0:1789448418.843609:0:13307:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff97d9f49419c0) has no exports 00010000:00010000:0.0:1789448418.843633:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448418.843643:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843653:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32c00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448418.843657:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843668:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448418.843676:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448418.843696:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448418.843699:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789448418.843702:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789448418.843718:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:0.0:1789448418.843723:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843730:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465f9779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f9780 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843749:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448418.843752:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843759:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9cae59400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448418.843762:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843768:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448418.843775:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448418.843780:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789448418.843782:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789448418.843785:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789448418.843789:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:0.0:1789448418.843792:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843806:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9cae59400/0xe29566c2465f99be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f99c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448418.843823:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448418.843825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448418.843827:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448418.843942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789448418.850410:0:13307:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d9fff52900 - data ffff97d9e3c62af8/ffff97d9fa670c00 00000020:01000000:2.0:1789448418.850537:0:13307:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97d8c1bf24e0 - data ffff97d9e3c62000/ffff97d9d1056800 00100000:10000000:3.0:1789448418.871121:0:13307:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789448418.920434:0:13307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f966f 00000020:00000080:2.0:1789448418.920448:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d8c1227000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789448418.920472:0:13307:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9e7a74000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789448418.920488:0:13307:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9e7a74000 2 00000020:01000004:2.0:1789448418.920492:0:13307:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97d9e7a74000 from lustre-OST0001 00000020:00000080:2.0:1789448418.920522:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789448418.920534:0:13307:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789448418.920538:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d8c1221000/lustre-OST0001_UUID 00000020:00000080:2.0:1789448418.920541:0:13307:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1221000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789448418.920550:0:13307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789448418.920664:0:13307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8c7fbad7-cbfc-4005-a352-7f3edcab574e->MGS 00010000:00010000:2.0:1789448418.920687:0:13307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448418.920701:0:13307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448418.920708:0:13307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789448418.920711:0:13307:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789448418.920715:0:13307:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789448418.920731:0:13307:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:2.0:1789448418.920735:0:13307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9c13a1a00/0xe29566c2465f9581 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f9588 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448418.920751:0:13307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448418.920759:0:13307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448418.920765:0:13307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789448418.920767:0:13307:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789448418.920769:0:13307:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789448418.920781:0:13307:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97d9ce94d000 00010000:00010000:2.0:1789448418.920784:0:13307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae33400/0xe29566c2465f97bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe29566c2465f97c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789448418.920813:0:13307:0:(import.c:65:import_set_state_nolock()) ffff97d9ce94d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789448418.920818:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789448418.920820:0:13307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789448418.920822:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789448418.920826:0:13307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789448418.920840:0:13307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97d9c7fd8a80 x1876372317363200/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789448420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1789448418.920953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1227000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1789448418.921663:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789448418.921669:0:13307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1789448418.921812:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7fbad7-cbfc-4005-a352-7f3edcab574e:3303:1876372317363200:0@lo:250:kworker.0 10000000:01000000:2.0:1789448418.921985:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789448418.921996:0:13307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9462 00000020:00000080:2.0:1789448418.922005:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d9d2e67800/8c7fbad7-cbfc-4005-a352-7f3edcab574e 00000020:01000000:2.0:1789448418.922026:0:13307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.154@tcp (flags='') 00000020:00000080:2.0:1789448418.922042:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448418.922049:0:13307:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789448418.922054:0:13307:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff97d9eaf63380) has no exports 00000020:00000080:0.0:1789448418.922113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9d2e67800/8c7fbad7-cbfc-4005-a352-7f3edcab574e for MGC192.168.202.154@tcp 10000000:01000000:3.0:1789448418.922177:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789448418.922533:0:13307:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.154@tcp: client import never connected 00000100:00080000:2.0:1789448418.922536:0:13307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789448418.922539:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789448418.922541:0:13307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789448418.922543:0:13307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789448418.922598:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789448418.922604:0:13307:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.154@tcp (uuid 8c7fbad7-cbfc-4005-a352-7f3edcab574e) 00000020:01000000:2.0:1789448418.922611:0:13307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789448418.922616:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448418.922620:0:13307:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789448418.922626:0:13307:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97d8c1220000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448418.922632:0:13307:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff97d8c196b380) has exports, disconnecting them 00000020:00080000:2.0:1789448418.922636:0:13307:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97d8c1220000), last request at 1789448193 00000020:00000080:2.0:1789448418.922641:0:13307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f9699 00000020:00080000:2.0:1789448418.922676:0:13307:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97d8c1220000): rc 0 00000020:00000080:2.0:1789448418.922681:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d8c1220000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789448418.922872:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9ce94d000 for MGC192.168.202.154@tcp 00000020:00000080:0.0:1789448418.922880:0:37:0:(genops.c:885:class_export_put()) final put ffff97d9ce94c800/8c7fbad7-cbfc-4005-a352-7f3edcab574e 00000020:00000080:0.0:1789448418.922883:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9ce94c800/8c7fbad7-cbfc-4005-a352-7f3edcab574e for MGC192.168.202.154@tcp 00000020:01000000:0.0:1789448418.922889:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.154@tcp (8c7fbad7-cbfc-4005-a352-7f3edcab574e) 00000020:00000080:3.0:1789448418.923525:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d8c1220000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789448418.925323:0:13307:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789448418.925334:0:13307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789448418.925339:0:13307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789448418.925348:0:13307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789448418.925475:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97d9f56c8800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789448418.944421:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789448418.944802:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789448418.944950:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789448418.945589:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97d9c4e0aa00:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1789448418.953426:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97d9c91c9000:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1789448418.953628:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954273:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97d9e0409800:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1789448418.954360:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97d9e0408400:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1789448418.954413:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97d9e0408a00:5820] 2 exiting: rc = 0 00000100:00100000:3.0:1789448418.954572:0:7613:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97d9fa88e800:7613] 3 exiting: rc = 0 00000100:00100000:0.0:1789448418.954685:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954694:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954707:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954714:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954722:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954743:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954750:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954758:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954765:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954772:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954778:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954784:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954791:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954798:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954804:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954811:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954820:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954825:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954831:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954838:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954844:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954849:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954867:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954873:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954880:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954886:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954892:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954897:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954904:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954911:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954916:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954921:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.954936:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955007:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955013:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955019:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955025:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955039:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955046:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955052:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955130:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955136:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955141:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955147:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955153:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955159:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955165:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955171:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955176:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955182:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955188:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955193:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955199:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955206:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955214:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955539:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955546:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955552:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955559:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955566:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955572:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955577:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955584:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.955590:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789448418.957326:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448418.957343:0:13307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789448418.957351:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d9fb0ac000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789448418.957357:0:13307:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9fb0ac000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789448418.957366:0:13307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789448418.957422:0:13307:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9e7a74000 1 00000020:00000080:0.0:1789448418.957430:0:13307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe29566c2465f963e 00000020:00000080:0.0:1789448418.957438:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d9e7a75800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789448418.957458:0:13307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789448418.957464:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448418.957479:0:13307:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789448418.957484:0:13307:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff97d8c19699c0) has no exports 00000020:00000080:3.0:1789448418.957627:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9e7a75800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789448418.973668:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448418.973689:0:13307:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789448418.973696:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d9e7a72000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789448418.973702:0:13307:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9e7a72000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789448418.973710:0:13307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789448418.974127:0:13307:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97d9e7a73800 00000020:01000000:3.0:1789448418.974168:0:13307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789448418.974173:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448418.974178:0:13307:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789448418.974183:0:13307:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff97d9ceaacd40) has no exports 00000020:00000080:3.0:1789448418.974212:0:13307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448418.974246:0:13307:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789448418.974249:0:13307:0:(genops.c:885:class_export_put()) final put ffff97d9c336e000/OSS_uuid 00000020:00000080:3.0:1789448418.974252:0:13307:0:(genops.c:844:class_export_destroy()) destroying export ffff97d9c336e000/OSS_uuid for OSS 00000020:01000000:3.0:1789448418.974256:0:13307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789448418.976325:0:6671:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff97d9f4a5b400:6671] 0 exiting: rc = 1 00000100:00100000:3.0:1789448418.976437:0:6672:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff97d9f4a7f200:6672] 1 exiting: rc = 0 00000100:00080000:3.0:1789448418.976471:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789448418.977660:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff97d9f4a7ee00:6673] 2 exiting: rc = 0 00000100:00100000:2.0:1789448418.977759:0:12513:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff97d9f57cfc00:12513] 4 exiting: rc = 0 00000100:00100000:0.0:1789448418.979206:0:10266:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff97d9fa7d8e00:10266] 3 exiting: rc = 0 00000100:00100000:3.0:1789448418.979585:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979605:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979613:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979621:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979626:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979632:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979639:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979645:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979651:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979657:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979663:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979669:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979675:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979681:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979689:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979696:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979702:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979708:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979715:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979721:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979727:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979733:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979739:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979745:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979752:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979758:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979765:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979771:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979778:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979784:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979790:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979795:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979818:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979824:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979830:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979836:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979841:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979847:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979853:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979859:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979866:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979873:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979879:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979884:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979890:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979896:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979902:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979908:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979913:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979918:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.979924:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980004:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980010:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980016:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980022:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980028:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980043:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980049:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980054:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980060:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980066:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980071:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980077:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448418.980083:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448418.981968:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97d9f53be200:6674] 0 exiting: rc = 1 00000100:00100000:2.0:1789448419.009747:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97d9f53bd400:6675] 1 exiting: rc = 0 00000100:00100000:3.0:1789448419.011488:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011505:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011511:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011536:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011542:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011548:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011554:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011561:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011567:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011729:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011739:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011745:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011752:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011758:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011764:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011770:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011776:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011781:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011788:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011794:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011799:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011805:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011812:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011819:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011825:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011830:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011836:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011843:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011849:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011854:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011860:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011866:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011871:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011876:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011881:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011887:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011893:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011899:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011914:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011921:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011927:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011933:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011938:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.011944:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014564:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014577:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014580:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014585:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014589:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014593:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014596:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014600:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014603:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014606:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014610:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014614:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014617:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014621:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014625:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014629:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014632:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014635:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014639:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.014642:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.020829:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97d9f5355a00:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1789448419.021983:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97d9f53bc600:6678] 2 exiting: rc = 0 00000100:00100000:0.0:1789448419.022716:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97d9f53bde00:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1789448419.022969:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.022978:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.022985:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.022992:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023000:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023008:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023014:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023023:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023058:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023065:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023071:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023078:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023084:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023190:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023198:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023204:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023210:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023305:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023315:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023322:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023328:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023348:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023357:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023363:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023369:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023377:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023383:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023389:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023444:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023452:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023459:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023465:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023472:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023477:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023483:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023490:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023496:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023502:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023508:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023736:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023748:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023756:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023763:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023778:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023785:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023806:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023817:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023823:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023831:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023838:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023844:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023851:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023858:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023864:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023871:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023877:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023883:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023889:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023896:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023902:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023913:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023919:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023925:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.023932:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448419.039317:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97d9f53bd200:6679] 0 exiting: rc = 1 00000100:00100000:2.0:1789448419.039564:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97d9f5354a00:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1789448419.040486:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040497:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040503:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040509:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040515:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040521:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040527:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040533:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040538:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040543:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040549:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040556:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040563:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040569:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040594:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040600:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040606:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040612:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040618:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040623:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040629:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040635:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040641:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040647:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040652:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040657:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040663:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040669:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040675:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040681:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040687:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040693:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040698:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040703:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040708:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040713:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040719:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040724:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040730:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040735:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040741:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040745:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040751:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040757:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040762:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040770:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040775:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040780:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040785:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040800:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040806:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040811:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040817:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040823:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040829:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040834:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040840:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040847:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040853:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040859:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040864:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040869:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040874:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448419.040880:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448419.044142:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97d9fac1fa00:6681] 0 exiting: rc = 1 00000100:00100000:3.0:1789448419.045778:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97d9f53bea00:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1789448419.045959:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.045971:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.045979:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.045986:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.045993:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.045999:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046006:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046013:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046020:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046028:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046045:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046052:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046059:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046084:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046208:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046245:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046254:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046262:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046269:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046277:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046283:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046291:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046298:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046305:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046313:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046334:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046343:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046366:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046374:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046381:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046389:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046395:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046403:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046410:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046417:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046424:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046432:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046452:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046461:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046468:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046475:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046481:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046490:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046497:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046504:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046512:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046519:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046526:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046534:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046554:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046563:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046570:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046577:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046584:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046593:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046601:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046610:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046617:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046625:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046632:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046640:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046647:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046660:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448419.046667:0:13307:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789448419.064007:0:13307:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789448437.127348:0:13921:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789448446.959170:0:14384:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789448446.959179:0:14384:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789448446.959350:0:14384:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97d9d0ac8800 00000020:01000004:3.0:1789448446.959371:0:14384:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789448446.959381:0:14384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789448446.959400:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97d9f4940000) 00000020:00000080:3.0:1789448446.959418:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789448446.998482:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789448447.004421:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789448447.004980:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789448447.005054:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 409: rc = 0 00100000:10000000:2.0:1789448447.006642:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 409: rc = 0 00100000:10000000:2.0:1789448447.006827:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 409: rc = 0 00100000:10000000:2.0:1789448447.008464:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:2.0:1789448447.008573:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 409: rc = 0 00100000:10000000:2.0:1789448447.008667:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 409: rc = 0 00100000:10000000:2.0:1789448447.010581:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 411: rc = 0 00100000:10000000:2.0:1789448447.012512:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 323: rc = 0 00100000:10000000:2.0:1789448447.012630:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 323: rc = 0 00100000:10000000:2.0:1789448447.016692:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 125: rc = 0 00100000:10000000:2.0:1789448447.018969:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 125: rc = 0 00100000:10000000:2.0:1789448447.020357:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 125: rc = 0 00100000:10000000:2.0:1789448447.020655:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 125: rc = 0 00100000:10000000:2.0:1789448447.020926:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 125: rc = 0 00100000:10000000:2.0:1789448447.021199:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 125: rc = 0 00100000:10000000:2.0:1789448447.021518:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 125: rc = 0 00100000:10000000:2.0:1789448447.021770:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 125: rc = 0 00100000:10000000:2.0:1789448447.022047:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 125: rc = 0 00100000:10000000:2.0:1789448447.022340:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 125: rc = 0 00100000:10000000:2.0:1789448447.022609:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 125: rc = 0 00100000:10000000:3.0:1789448447.024438:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 125: rc = 0 00100000:10000000:3.0:1789448447.025330:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 559: rc = 0 00100000:10000000:3.0:1789448447.025578:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 559: rc = 0 00100000:10000000:3.0:1789448447.025876:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 559: rc = 0 00100000:10000000:3.0:1789448447.026139:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 559: rc = 0 00100000:10000000:3.0:1789448447.026601:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 559: rc = 0 00100000:10000000:3.0:1789448447.026857:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 559: rc = 0 00100000:10000000:3.0:1789448447.027456:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 559: rc = 0 00100000:10000000:3.0:1789448447.027709:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 559: rc = 0 00100000:10000000:3.0:1789448447.028720:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 559: rc = 0 00100000:10000000:3.0:1789448447.029043:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 559: rc = 0 00100000:10000000:3.0:1789448447.029370:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 559: rc = 0 00100000:10000000:3.0:1789448447.029631:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 559: rc = 0 00100000:10000000:3.0:1789448447.029897:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 559: rc = 0 00100000:10000000:3.0:1789448447.030148:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 559: rc = 0 00100000:10000000:3.0:1789448447.030470:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 559: rc = 0 00100000:10000000:3.0:1789448447.030721:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 559: rc = 0 00100000:10000000:3.0:1789448447.031029:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 559: rc = 0 00100000:10000000:3.0:1789448447.031322:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 559: rc = 0 00100000:10000000:3.0:1789448447.031585:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 559: rc = 0 00100000:10000000:3.0:1789448447.035359:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 559: rc = 0 00100000:10000000:3.0:1789448447.035706:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 559: rc = 0 00100000:10000000:3.0:1789448447.036001:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 559: rc = 0 00100000:10000000:3.0:1789448447.036341:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 559: rc = 0 00100000:10000000:3.0:1789448447.036612:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 559: rc = 0 00100000:10000000:3.0:1789448447.036897:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 559: rc = 0 00100000:10000000:3.0:1789448447.037179:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 559: rc = 0 00100000:10000000:3.0:1789448447.037498:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 559: rc = 0 00100000:10000000:3.0:1789448447.043852:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 559: rc = 0 00100000:10000000:3.0:1789448447.044545:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 559: rc = 0 00100000:10000000:3.0:1789448447.044745:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 559: rc = 0 00100000:10000000:3.0:1789448447.046001:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 559: rc = 0 00100000:10000000:3.0:1789448447.049602:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 559: rc = 0 00100000:10000000:3.0:1789448447.050079:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 328: rc = 0 00100000:10000000:3.0:1789448447.052264:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789448447.052441:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1789448447.052604:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789448447.052647:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1789448447.052840:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789448447.053454:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1789448447.053845:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789448447.057334:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 324: rc = 0 00100000:10000000:2.0:1789448447.057748:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789448447.057965:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 324: rc = 0 00100000:10000000:2.0:1789448447.058448:0:14384:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789448447.058522:0:14384:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 324: rc = 0 00000020:00000080:2.0:1789448447.059263:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789448447.059275:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789448447.059293:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa755 00000020:01000004:2.0:1789448447.059305:0:14384:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789448447.059311:0:14384:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789448447.059318:0:14384:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97d9d0ac8800 from MGS 00000020:01000004:2.0:1789448447.059323:0:14384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789448447.059337:0:14384:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97d8c196cd40) 00000020:00000080:2.0:1789448447.059350:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789448447.059425:0:14384:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9d0ac8800 from MGS, refs=2 00080000:01000000:2.0:1789448447.059431:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789448447.059437:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa763 00000100:00100000:2.0:1789448447.059575:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789448447.059734:0:14384:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789448447.059741:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789448447.069414:0:14384:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789448447.072448:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789448447.073681:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448447.074325:0:14384:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789448447.074334:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789448447.087875:0:14384:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789448447.088097:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789448447.088727:0:14384:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789448447.088736:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789448447.089649:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.089654:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.089656:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.089947:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.089950:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.089952:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448447.090810:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789448447.096970:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789448447.124676:0:14384:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789448447.124703:0:14384:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789448447.124707:0:14384:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789448447.130615:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789448447.130903:0:14384:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789448447.131058:0:14384:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789448447.132496:0:14384:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789448447.134279:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448447.134537:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789448447.134545:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789448447.159260:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789448447.159647:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789448447.163824:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789448447.163840:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789448447.166692:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789448447.166746:0:14384:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:2.0:1789448447.166749:0:14384:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789448447.166808:0:14384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:2.0:1789448447.166827:0:14384:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (ffff97d8c1968000) 00000020:00000080:2.0:1789448447.166849:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789448447.167524:0:14384:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9e7aac800@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789448447.167733:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:2.0:1789448447.167741:0:14384:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789448447.168156:0:14398:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789448447.168851:0:14399:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789448447.168959:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 67d9a8de-e7f1-4030-af60-fc835c982539) 00000020:00000080:3.0:1789448447.168994:0:14384:0:(genops.c:1384:class_connect()) connect: client 67d9a8de-e7f1-4030-af60-fc835c982539, cookie 0xe29566c2465fa771 00000100:00080000:3.0:1789448447.169010:0:14384:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448447.169024:0:14384:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff97d9e7aac800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448447.169069:0:14384:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54bbb80 x1876372317363456/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448447.169107:0:14384:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 67d9a8de-e7f1-4030-af60-fc835c982539->MGS 00000100:00100000:1.0:1789448447.169310:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:67d9a8de-e7f1-4030-af60-fc835c982539:3303:1876372317363456:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789448447.169401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.169545:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317363456 00000100:00100000:2.0:1789448447.169555:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317363456 00000100:00100000:2.0:1789448447.169604:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448447.169614:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1876372317363456:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789448447.169647:0:14395:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 67d9a8de-e7f1-4030-af60-fc835c982539@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1789448447.169677:0:14395:0:(genops.c:1384:class_connect()) connect: client 67d9a8de-e7f1-4030-af60-fc835c982539, cookie 0xe29566c2465fa778 00000100:00080000:2.0:1789448447.169860:0:14395:0:(import.c:65:import_set_state_nolock()) ffff97d9e7aab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448447.170003:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+5:3303:x1876372317363456:12345-0@lo:250:mount.lustre.0 Request processed in 387us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448447.170012:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448447.170166:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789448447.170179:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1789448447.170188:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789448447.170194:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789448447.170197:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9e7aac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789448447.170200:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789448447.170316:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789448447.170324:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:67d9a8de-e7f1-4030-af60-fc835c982539:3303:1876372317363456:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1789448447.170662:0:14384:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789448447.170672:0:14384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789448447.170693:0:14384:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97d9f4943380) 00000020:00000080:3.0:1789448447.170707:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789448447.195343:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448447.195624:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789448447.195632:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789448447.202109:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789448447.202131:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789448447.206839:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789448447.206857:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789448447.208193:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448447.208491:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789448447.208498:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789448447.210191:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789448447.211127:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789448447.283132:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448447.283378:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789448447.283385:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789448447.286208:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789448447.286248:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789448447.286999:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448447.287188:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448447.287194:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789448447.288078:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789448447.288086:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789448447.289382:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448447.289545:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448447.289557:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789448447.290021:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789448447.290028:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789448447.292423:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448447.292611:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448447.292616:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789448447.302914:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789448447.302927:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789448447.332394:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448447.332901:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789448447.332909:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789448447.334360:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789448447.334369:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789448447.338026:0:14384:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789448447.338042:0:14384:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789448447.339942:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789448447.339967:0:14384:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789448447.339973:0:14384:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789448447.340169:0:14384:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789448447.340213:0:14384:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789448447.340235:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789448447.340238:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789448447.340240:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448447.340242:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448447.340251:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448447.340253:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448447.340254:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789448447.340256:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789448447.340258:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448447.340259:0:14384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448447.340262:0:14384:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789448447.340266:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448447.340267:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789448447.340270:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448447.340272:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448447.340273:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448447.340274:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448447.340276:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789448447.340278:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789448447.340279:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448447.340281:0:14384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448447.340306:0:14384:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789448447.340324:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448447.340392:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448447.340493:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317363584 00000100:00100000:1.0:1789448447.340509:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317363584 00000100:00100000:1.0:1789448447.340579:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448447.340591:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+5:14384:x1876372317363584:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448447.340620:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe53c0 going to sleep for 11 seconds 20000000:01000000:1.0:1789448447.340664:0:14397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789448447.340669:0:14397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789448447.340673:0:14397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789448447.341334:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789448447.341994:0:14397:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789448447.343467:0:14419:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789448447.343474:0:14419:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789448447.343676:0:14419:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789448447.343717:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789448447.343998:0:14397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789448447.344009:0:14397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789448447.354788:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+5:14384:x1876372317363584:12345-0@lo:253:mount.lustre.0 Request processed in 14181us (14377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448447.354811:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448447.354939:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789448447.354953:0:14384:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789448447.354957:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789448447.354959:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789448447.354960:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448447.354962:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448447.354963:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448447.354965:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448447.354967:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789448447.354969:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789448447.354971:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448447.354972:0:14384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789448447.354990:0:14384:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97d9d0ac8800 from lustre-MDT0000 10000000:01000000:2.0:1789448447.355014:0:14384:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789448447.355017:0:14384:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789448447.355021:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97d8c1968000 10000000:01000000:2.0:1789448447.355025:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448447.355033:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97d8c1968000 from 1 10000000:01000000:2.0:1789448447.355036:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789448447.355072:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.355083:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.355159:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.355179:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448447.355332:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.355396:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448447.355431:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317363712 00000100:00100000:1.0:1789448447.355439:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317363712 00000100:00100000:1.0:1789448447.355610:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448447.355620:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+5:14384:x1876372317363712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448447.355633:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448447.355648:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34e00/0xe29566c2465fa78d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa786 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.355668:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34e00/0xe29566c2465fa78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa786 expref: 6 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.355680:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34e00/0xe29566c2465fa78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa786 expref: 6 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.355689:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34e00, rc 0) 00000100:00100000:1.0:1789448447.355734:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+6:14384:x1876372317363712:12345-0@lo:101:mount.lustre.0 Request processed in 116us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448447.355741:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448447.355819:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448447.355832:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.355841:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.355888:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448447.355916:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.356052:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.356195:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317363840 00000100:00100000:3.0:1789448447.356200:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317363840 00000100:00100000:3.0:1789448447.356253:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448447.356260:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+6:14384:x1876372317363840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448447.356496:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+6:14384:x1876372317363840:12345-0@lo:501:mount.lustre.0 Request processed in 236us (579us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448447.356503:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448447.356598:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363840:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789448447.356625:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789448447.356643:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.356652:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.356661:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97d9d0ac8800 10000000:01000000:2.0:1789448447.356666:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789448447.356670:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97d9d0ac8800 10000000:01000000:2.0:1789448447.356673:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789448447.356676:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97d9d0ac8800 from 1 10000000:01000000:2.0:1789448447.356679:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789448447.356697:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.356711:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.356720:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.356732:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448447.356757:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.356780:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448447.356934:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317363968 00000100:00100000:1.0:1789448447.356939:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317363968 00000100:00100000:1.0:1789448447.356958:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448447.356965:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+6:14384:x1876372317363968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448447.356973:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448447.356982:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34400/0xe29566c2465fa79b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa794 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.356998:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34400/0xe29566c2465fa79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa794 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.357007:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34400/0xe29566c2465fa79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa794 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.357015:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34400, rc 0) 00000100:00100000:1.0:1789448447.357190:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+7:14384:x1876372317363968:12345-0@lo:101:mount.lustre.0 Request processed in 224us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448447.357197:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789448447.359438:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317363968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448447.359467:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa79b expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.359482:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa79b expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.359501:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789448447.359677:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa79b expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.359687:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc2c00/0xe29566c2465fa794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa79b expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.359695:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789448447.359704:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448447.359710:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97d9d0ac8800 10000000:01000000:2.0:1789448447.359716:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789448447.359732:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789448447.359735:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789448447.359765:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.359785:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.359804:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.359825:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448447.359879:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.359920:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.360035:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364096 00000100:00100000:3.0:1789448447.360044:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364096 00000100:00100000:3.0:1789448447.360100:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448447.360109:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+7:14384:x1876372317364096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448447.360120:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448447.360135:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad27800/0xe29566c2465fa7a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa7a2 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.360155:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27800/0xe29566c2465fa7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa7a2 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.360164:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad27800/0xe29566c2465fa7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa7a2 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.360172:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27800, rc 0) 00000100:00100000:3.0:1789448447.360212:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+8:14384:x1876372317364096:12345-0@lo:101:mount.lustre.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.360243:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448447.360504:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448447.360526:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa7a9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.360535:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa7a9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.360583:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448447.360607:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.360633:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448447.360734:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364224 00000100:00100000:1.0:1789448447.360739:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364224 00000100:00100000:1.0:1789448447.360760:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448447.360767:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+8:14384:x1876372317364224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448447.361204:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+9:14384:x1876372317364224:12345-0@lo:501:mount.lustre.0 Request processed in 436us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448447.361212:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448447.361470:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448447.361503:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448447.361553:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.361591:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448447.361605:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364352 00000100:00100000:2.0:1789448447.361609:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364352 00000100:00100000:2.0:1789448447.361635:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448447.361641:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+9:14384:x1876372317364352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448447.361954:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+9:14384:x1876372317364352:12345-0@lo:503:mount.lustre.0 Request processed in 312us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448447.361961:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448447.362077:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448447.365978:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14420:1876372317364480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448447.366061:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448447.366170:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef100f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448447.366255:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364480 00000100:00100000:2.0:1789448447.366263:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364480 00000100:00100000:2.0:1789448447.366298:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448447.366306:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+9:14420:x1876372317364480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448447.366630:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+9:14420:x1876372317364480:12345-0@lo:502:llog_process_th.0 Request processed in 323us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448447.366637:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448447.366815:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14420:1876372317364480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448447.366845:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448447.366855:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.366858:0:14420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789448447.366865:0:14420:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789448447.366868:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448447.366889:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97d9f49419c0) 00000020:00000080:3.0:1789448447.366908:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789448447.366914:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789448447.366986:0:14420:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789448447.366994:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa7b7 00000020:00000080:3.0:1789448447.367265:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789448447.367271:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.367275:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.367276:0:14420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789448447.367279:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448447.367282:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.367284:0:14420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789448447.367287:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448447.367294:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97d9f4944d40) 00000020:00000080:3.0:1789448447.367304:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789448447.367308:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789448447.367310:0:14420:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789448447.367312:0:14420:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789448447.367318:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448447.367356:0:14420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9d0ac8800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789448447.367377:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97d9f54d0000) 00000020:00000080:3.0:1789448447.367386:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789448447.367436:0:14420:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789448447.367443:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465fa7cc 00000020:00000080:3.0:1789448447.367543:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789448447.367550:0:14420:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789448447.367554:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe29566c2465fa7d3 00080000:01000000:3.0:1789448447.367559:0:14420:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789448447.367563:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa7da 00010000:00010000:3.0:1789448447.461700:0:14420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789448447.462644:0:14420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789448447.462877:0:14420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789448447.463368:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97d9f54d4d40) 00000020:00000080:3.0:1789448447.463399:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789448447.463478:0:14420:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789448447.463487:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa7e8 00000020:00000080:3.0:1789448447.474359:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789448447.477247:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe29566c2465fa7ef 00000020:00000080:2.0:1789448447.479075:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789448447.479089:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448447.479095:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.479097:0:14420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789448447.479113:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448447.479119:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.479121:0:14420:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789448447.479125:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789448447.479163:0:14420:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789448447.479179:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448447.479183:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.479184:0:14420:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789448447.479193:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789448447.479195:0:14420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789448447.479197:0:14420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448447.479198:0:14420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448447.479200:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789448447.479202:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.479204:0:14420:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789448447.479206:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789448447.479209:0:14420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789448447.479212:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.479214:0:14420:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789448447.479236:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789448447.479242:0:14420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:2.0:1789448447.479266:0:14420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789448447.479269:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789448447.479284:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97d8c19699c0) 00000020:00000080:2.0:1789448447.479299:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789448447.479304:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789448447.479357:0:14420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789448447.479363:0:14420:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789448447.479369:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa7fd 00010000:00080000:2.0:1789448447.479401:0:14420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9d2e64800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789448447.479792:0:14420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789448447.480111:0:14420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789448447.480151:0:14420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789448447.482818:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448447.482895:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789448447.482984:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789448447.483373:0:14424:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789448447.483377:0:14424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789448447.484628:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448447.484642:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789448447.484676:0:14420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789448447.484701:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465fa804 00000100:00080000:3.0:1789448447.484712:0:14420:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448447.484723:0:14420:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97d9d2e64800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448447.484760:0:14420:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54b8e00 x1876372317364608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448447.484802:0:14420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789448447.484856:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.484860:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.484862:0:14420:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789448447.484866:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789448447.484868:0:14420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789448447.484870:0:14420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789448447.484871:0:14420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789448447.484873:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789448447.484875:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.484876:0:14420:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789448447.484879:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789448447.484883:0:14420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789448447.484886:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.484888:0:14420:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789448447.484890:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789448447.484894:0:14420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1789448447.484914:0:14420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789448447.484926:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448447.484938:0:14420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97d9f54d19c0) 00000020:00000080:3.0:1789448447.484950:0:14420:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789448447.484955:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789448447.485021:0:14420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789448447.485027:0:14420:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789448447.485033:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe29566c2465fa812 00010000:00080000:3.0:1789448447.485059:0:14420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9d2e64000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789448447.485301:0:14420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789448447.485482:0:14420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789448447.485506:0:14420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789448447.486072:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789448447.486147:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789448447.486211:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1789448447.486643:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317364608:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789448447.486709:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876372317364608 offset 0 length 520: 4 00000040:00080000:0.0:1789448447.487990:0:14426:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789448447.487996:0:14426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789448447.489622:0:14420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448447.489636:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789448447.489674:0:14420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789448447.489696:0:14420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465fa819 00000100:00080000:3.0:1789448447.489707:0:14420:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448447.489719:0:14420:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9d2e64000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448447.489756:0:14420:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54ba300 x1876372317364736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789448447.489827:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317364736:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789448447.489880:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876372317364736 offset 0 length 520: 4 00000100:00080000:3.0:1789448447.489934:0:14420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789448447.490002:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.490007:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.490009:0:14420:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789448447.490012:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448447.490015:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.490017:0:14420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448447.490019:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448447.490021:0:14420:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789448447.490033:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.490036:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.490037:0:14420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789448447.490040:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448447.490042:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.490043:0:14420:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789448447.490046:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789448447.490075:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14420:1876372317364864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448447.490247:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.490277:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364864 00000100:00100000:3.0:1789448447.490283:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364864 00000100:00100000:3.0:1789448447.490318:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448447.490327:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+9:14420:x1876372317364864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448447.490639:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+9:14420:x1876372317364864:12345-0@lo:502:llog_process_th.0 Request processed in 312us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.490647:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448447.490688:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.490710:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14420:1876372317364864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448447.490735:0:14420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.490739:0:14420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.490741:0:14420:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789448447.490744:0:14420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789448447.491005:0:14384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789448447.491028:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789448447.491059:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa7a9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.491071:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3600/0xe29566c2465fa7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa7a9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.491079:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9d0ac8800 from 1 10000000:01000000:2.0:1789448447.491082:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789448447.491197:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.491206:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.491358:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.491376:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448447.491487:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.491556:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999780 going to sleep for 11 seconds 00000100:00100000:1.0:1789448447.491919:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317364992 00000100:00100000:1.0:1789448447.491927:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317364992 00000100:00100000:1.0:1789448447.491993:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448447.492003:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+9:14384:x1876372317364992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448447.492016:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448447.492031:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa820 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.492055:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa820 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.492065:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa820 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448447.492073:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34800, rc 0) 00000100:00100000:1.0:1789448447.492130:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+10:14384:x1876372317364992:12345-0@lo:101:mount.lustre.0 Request processed in 130us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448447.492137:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789448447.492208:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317364992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448447.492249:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.492259:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.492791:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365120:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789448447.492831:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.493462:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.493585:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365120 00000100:00100000:3.0:1789448447.493594:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365120 00000100:00100000:3.0:1789448447.493628:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448447.493635:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+10:14384:x1876372317365120:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789448447.493653:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789448447.493659:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789448447.493758:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+10:14384:x1876372317365120:12345-0@lo:256:mount.lustre.0 Request processed in 122us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.493782:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789448447.493862:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365120:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789448447.494588:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448447.494609:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.494620:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.494628:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9d0ac8800 from 1 10000000:01000000:2.0:1789448447.494631:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448447.494663:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.494671:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.494680:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.494698:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448447.494739:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.494757:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.494905:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365248 00000100:00100000:3.0:1789448447.494913:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365248 00000100:00100000:3.0:1789448447.494943:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448447.494951:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+10:14384:x1876372317365248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448447.494964:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448447.494979:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa82e expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.495002:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.495011:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.495019:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448447.495049:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365248:12345-0@lo:101:mount.lustre.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.495055:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448447.495212:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448447.495253:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.495261:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448447.495326:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448447.495351:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.495373:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.495454:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365376 00000100:00100000:3.0:1789448447.495458:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365376 00000100:00100000:3.0:1789448447.495476:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448447.495482:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448447.495866:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365376:12345-0@lo:501:mount.lustre.0 Request processed in 383us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.495874:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448447.496025:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448447.496056:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448447.496095:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.496133:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.496295:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365504 00000100:00100000:3.0:1789448447.496305:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365504 00000100:00100000:3.0:1789448447.496325:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448447.496331:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448447.496531:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365504:12345-0@lo:503:mount.lustre.0 Request processed in 199us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.496539:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448447.496609:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448447.496943:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14428:1876372317365632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448447.496980:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.498453:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999600 going to sleep for 11 seconds 00000100:00100000:1.0:1789448447.498592:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365632 00000100:00100000:1.0:1789448447.498602:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365632 00000100:00100000:0.0:1789448447.498740:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448447.498752:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+11:14428:x1876372317365632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448447.499048:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+11:14428:x1876372317365632:12345-0@lo:502:llog_process_th.0 Request processed in 298us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448447.499062:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448447.499184:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14428:1876372317365632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789448447.499231:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448447.499240:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.499243:0:14428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789448447.499251:0:14428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9d0ac8800 00000020:00000080:2.0:1789448447.499253:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789448447.499260:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448447.499263:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.499264:0:14428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789448447.499267:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448447.499269:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448447.499270:0:14428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789448447.499273:0:14428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9d0ac8800 00000020:00000080:2.0:1789448447.499275:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789448447.499336:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.504808:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.504816:0:14428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789448447.504830:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448447.504838:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.504839:0:14428:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789448447.504846:0:14428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97d9d0ac8800 00000020:00000080:3.0:1789448447.504848:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789448447.504948:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14428:1876372317365760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448447.505040:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.505087:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365760 00000100:00100000:3.0:1789448447.505094:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365760 00000100:00100000:3.0:1789448447.505147:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789448447.505155:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14428:x1876372317365760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448447.505392:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14428:x1876372317365760:12345-0@lo:502:llog_process_th.0 Request processed in 237us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.505400:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789448447.505463:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.505485:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14428:1876372317365760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448447.505510:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448447.505514:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448447.505515:0:14428:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789448447.505519:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789448447.505587:0:14384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789448447.505609:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448447.505624:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505635:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448447.505675:0:14384:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789448447.505678:0:14384:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97d9d0ac8800 10000000:01000000:3.0:1789448447.505681:0:14384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97d9d0ac8800 10000000:01000000:3.0:1789448447.505686:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789448447.505692:0:14384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9d0ac8800 from 1 10000000:01000000:3.0:1789448447.505695:0:14384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789448447.505721:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505729:0:14384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505738:0:14384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448447.505750:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789448447.505789:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.505806:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.505828:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317365888 00000100:00100000:3.0:1789448447.505832:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317365888 00000100:00100000:3.0:1789448447.505848:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448447.505853:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317365888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448447.505870:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448447.505881:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad27a00/0xe29566c2465fa843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa83c expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505900:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27a00/0xe29566c2465fa843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa83c expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505908:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad27a00/0xe29566c2465fa843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa83c expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505915:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27a00, rc 0) 00000100:00100000:3.0:1789448447.505942:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317365888:12345-0@lo:101:mount.lustre.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.505948:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448447.505979:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317365888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448447.505990:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa843 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.505998:0:14384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa843 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448447.506034:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448447.506054:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.506064:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.506075:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366016 00000100:00100000:3.0:1789448447.506078:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366016 00000100:00100000:3.0:1789448447.506092:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448447.506097:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317366016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448447.506344:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317366016:12345-0@lo:501:mount.lustre.0 Request processed in 245us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.506351:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448447.506380:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448447.506404:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448447.506437:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.506455:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ffec70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.506466:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366144 00000100:00100000:3.0:1789448447.506470:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366144 00000100:00100000:3.0:1789448447.506486:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448447.506491:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317366144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448447.506640:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317366144:12345-0@lo:503:mount.lustre.0 Request processed in 148us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.506647:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448447.506684:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448447.514303:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14430:1876372317366272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448447.514390:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.514504:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.515534:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366272 00000100:00100000:3.0:1789448447.515544:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366272 00000100:00100000:3.0:1789448447.515597:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789448447.515607:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:14430:x1876372317366272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448447.515897:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:14430:x1876372317366272:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.515904:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448447.516029:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14430:1876372317366272:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789448447.516093:0:14430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789448447.516109:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97d8c196b380) 00000020:00000080:2.0:1789448447.516129:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789448447.516212:0:14430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9d0ac8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789448447.516240:0:14430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9d0ac8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789448447.516244:0:14430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9d0ac8800 4 00010000:00080000:2.0:1789448447.516272:0:14430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9fc56f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789448447.522109:0:14430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789448447.522343:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789448447.522381:0:14430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789448447.522393:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe29566c2465fa851 00000100:00080000:2.0:1789448447.522404:0:14430:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789448447.526291:0:14430:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97d9fc56f800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1789448447.526333:0:14430:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9d138e300 x1876372317366400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448447.526380:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317366400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448447.526786:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789448447.526849:0:14430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789448447.530883:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366400 00000100:00100000:1.0:1789448447.530897:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366400 00000100:00100000:1.0:1789448447.530937:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448447.530947:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317366400:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789448447.531043:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317366400:12345-0@lo:38:llog_process_th.0 Request processed in 96us (4257us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789448447.531061:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448447.531630:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448447.531640:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9fc56f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448447.531645:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789448447.531649:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317366400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448447.531785:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14430:1876372317366528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448447.531845:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448447.531874:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366528 00000100:00100000:2.0:1789448447.531879:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366528 00000100:00100000:2.0:1789448447.531917:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448447.531924:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14430:x1876372317366528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448447.532566:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14430:x1876372317366528:12345-0@lo:502:llog_process_th.0 Request processed in 639us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448447.532575:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448447.532686:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1999b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448447.532704:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67d9a8de-e7f1-4030-af60-fc835c982539:14430:1876372317366528:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789448447.532726:0:14430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789448447.538456:0:14384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789448447.538497:0:14384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789448447.538515:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa843 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.538538:0:14384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fad26600/0xe29566c2465fa83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa843 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789448447.538592:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789448447.538595:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789448447.538596:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448447.538598:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448447.538599:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448447.538600:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448447.538602:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789448447.538603:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789448447.538605:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448447.538606:0:14384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448447.538610:0:14384:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789448447.538613:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789448447.538614:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789448447.538615:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448447.538616:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448447.538617:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448447.538618:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448447.538619:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789448447.538620:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789448447.538621:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448447.538622:0:14384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448447.538648:0:14384:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789448447.538670:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789448447.538738:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.538785:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d0752840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448447.542378:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366656 00000100:00100000:2.0:1789448447.542394:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366656 00000100:00100000:2.0:1789448447.542478:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448447.542489:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14384:x1876372317366656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789448447.542523:0:14395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789448447.542537:0:14395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789448447.604826:0:14395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789448447.604839:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789448447.605291:0:14418:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789448447.605297:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789448447.605321:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.605340:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa820 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.605361:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.605403:0:14418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.605784:0:14418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 12 pid: 14397 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448447.605810:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317366784:0@lo:104: 00000100:00100000:3.0:1789448447.605879:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.605919:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d11f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448447.605957:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366784 00000100:00100000:3.0:1789448447.605964:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366784 00000100:00100000:3.0:1789448447.606013:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448447.606021:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317366784:12345-0@lo:104: 00010000:00010000:3.0:1789448447.606034:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606079:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448447.606085:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317366784:12345-0@lo:104: Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.606092:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448447.606127:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317366784:0@lo:104: 00010000:00010000:3.0:1789448447.606147:0:14418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606293:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448447.606300:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606308:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3e00 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448447.606313:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606336:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448447.606344:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448447.606351:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448447.606426:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606434:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448447.606455:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606463:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa827 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448447.606552:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.606554:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448447.606556:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448447.606580:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317366912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448447.606614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448447.606739:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317366912 00000100:00100000:3.0:1789448447.606748:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317366912 00010000:00010000:3.0:1789448447.606778:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 13 pid: 14397 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448447.606805:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448447.606812:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+13:3306:x1876372317366912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448447.606824:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448447.606829:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 13 pid: 14397 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606838:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 13 pid: 14397 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606849:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa820 expref: 13 pid: 14397 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606861:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606868:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789448447.606880:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001584308s 00010000:00010000:3.0:1789448447.606884:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606890:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606897:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606911:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606916:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448447.606920:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606927:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606939:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.606947:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448447.606978:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+12:3306:x1876372317366912:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448447.606985:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789448447.607003:0:14418:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.607010:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448447.607016:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa858 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448447.607039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317366912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448447.613810:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14384:x1876372317366656:12345-0@lo:253:mount.lustre.0 Request processed in 71305us (75052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448447.613826:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448447.613970:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:14384:1876372317366656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789448447.614004:0:14384:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789448447.614007:0:14384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789448447.614009:0:14384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789448447.614010:0:14384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448447.614012:0:14384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448447.614013:0:14384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448447.614014:0:14384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448447.614015:0:14384:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789448447.614016:0:14384:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789448447.614018:0:14384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448447.614019:0:14384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789448447.614035:0:14384:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789448447.623179:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789448447.623926:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789448447.625045:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448447.625683:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448447.626062:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448447.626207:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789448447.627745:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789448447.627995:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448447.628697:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448447.629027:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448447.629382:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448447.629777:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789448447.679134:0:14384:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789448447.679957:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789448447.680194:0:14442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789448447.680290:0:14442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789448447.683170:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789448447.683321:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789448447.683840:0:14384:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789448447.683848:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789448447.683958:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789448447.686626:0:14441:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789448447.686635:0:14441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789448447.688060:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789448447.688133:0:14442:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789448447.688138:0:14442:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789448447.691059:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789448447.696095:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789448447.696159:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789448447.699023:0:14384:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789448447.705026:0:14384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789448447.766435:0:14384:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789448447.766472:0:14384:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8ae8184b988 00100000:10000000:1.0:1789448447.766481:0:14384:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789448447.767517:0:14384:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789448447.767533:0:14384:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789448447.767547:0:14384:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789448447.767566:0:14384:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789448448.154206:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789448448.409372:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789448448.409383:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9d0ac8800 from 6 10000000:01000000:0.0:1789448448.409389:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789448448.409442:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448448.409455:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448448.409466:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448448.409490:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448448.409555:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448448.411073:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448448.412549:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367040 00000100:00100000:2.0:1789448448.412562:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367040 00000100:00100000:3.0:1789448448.414414:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448448.414429:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+11:14399:x1876372317367040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448448.414448:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448448.414470:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa85f expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448448.414498:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa85f expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448448.414509:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa85f expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448448.414518:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27000, rc 0) 00000100:00100000:3.0:1789448448.414708:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (5150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448448.414728:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448448.414807:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448448.414825:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448448.414833:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448448.414899:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789448448.414938:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448448.415204:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448448.419738:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367168 00000100:00100000:1.0:1789448448.419751:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367168 00000100:00100000:1.0:1789448448.420111:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789448448.420122:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789448448.420145:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789448448.420163:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789448448.420166:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789448448.420841:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 666us (5847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448448.420852:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789448448.423096:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789448448.423161:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789448448.423172:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448448.423185:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448448.603336:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448449.179770:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789448449.631662:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448450.201416:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448451.230441:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448452.252159:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448452.594378:0:14685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789448452.889755:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1789448452.890050:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448452.890055:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448452.890058:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448452.890061:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448452.890063:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789448452.890081:0:13978:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789448452.890085:0:13978:0:(import.c:65:import_set_state_nolock()) ffff97d9fc56f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448452.890100:0:13978:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97d9fc56f800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448452.890130:0:13978:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54b9f80 x1876372317367424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448452.890169:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317367424:0@lo:38:kworker.0 00000100:00100000:3.0:1789448452.890256:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448452.890969:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367424 00000100:00100000:1.0:1789448452.890979:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367424 00000100:00100000:1.0:1789448452.891034:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448452.891041:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876372317367424:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789448452.891069:0:14404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1789448452.891102:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe29566c2465fa86d 00000004:00100000:1.0:1789448452.891118:0:14404:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789448452.891287:0:14404:0:(import.c:65:import_set_state_nolock()) ffff97d9f4fc9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448452.891356:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876372317367424:12345-0@lo:38:kworker.0 Request processed in 314us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448452.891363:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789448452.891473:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9f54b9f80 x1876372317367424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448452.891488:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789448452.891494:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789448452.891499:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789448452.891501:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9fc56f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789448452.891506:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876372317367424:0@lo:38:kworker.0 00000100:00100000:0.0:1789448452.892661:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317367296:0@lo:400:kworker.0 00000100:00100000:0.0:1789448452.892806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448452.892990:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367296 00000100:00100000:3.0:1789448452.892997:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367296 00000100:00100000:3.0:1789448452.893093:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789448452.893102:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:3306:x1876372317367296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448452.893159:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:3306:x1876372317367296:12345-0@lo:400:kworker.0 Request processed in 58us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448452.893166:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448452.893271:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317367296:0@lo:400:kworker.0 00010000:00010000:2.0:1789448453.277900:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448454.297809:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448455.324445:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789448455.517569:0:14835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec538a880 20000000:00000080:1.0:1789448455.517589:0:14835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d9ce922800 uarg=0000000000000000 20000000:01000000:1.0:1789448455.517623:0:14835:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789448455.517630:0:14835:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789448455.517635:0:14835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789448455.518786:0:14836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789448455.518896:0:14835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789448455.531503:0:14835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789448455.532071:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.532093:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.532101:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.532556:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.532588:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448455.532605:0:14835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1876372317367552:0@lo:104: 00000100:00100000:2.0:1789448455.532672:0:14835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448455.534163:0:14835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1084480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448455.534204:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367552 00000100:00100000:3.0:1789448455.534243:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367552 00000100:00100000:3.0:1789448455.534324:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448455.534338:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:14835:x1876372317367552:12345-0@lo:104: 00010000:00010000:3.0:1789448455.534379:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.534494:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448455.534501:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:14835:x1876372317367552:12345-0@lo:104: Request processed in 168us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448455.534510:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789448455.534529:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448455.534541:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448455.534566:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448455.534570:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448455.534580:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448455.534587:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448455.534593:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789448455.534646:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448455.534653:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448455.534701:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448455.534709:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3800/0xe29566c2465fa82e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa835 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448455.534931:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448455.534933:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448455.534935:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448455.534975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448455.534988:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317367680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448455.535038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448455.535111:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367680 00000100:00100000:3.0:1789448455.535119:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367680 00010000:00010000:3.0:1789448455.535156:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 12 pid: 14395 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448455.535193:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448455.535203:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+12:3305:x1876372317367680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448455.535244:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448455.535251:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 12 pid: 14395 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535263:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 12 pid: 14395 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535283:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535292:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535309:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535326:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535333:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535340:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535346:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448455.535351:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535359:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535367:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448455.535374:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448455.535404:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+12:3305:x1876372317367680:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448455.535411:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448455.535546:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317367680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448455.536051:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fad27200/0xe29566c2465fa835 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa82e expref: 11 pid: 14395 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448455.536065:0:14835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1876372317367552:0@lo:104: 00010000:00010000:2.0:1789448455.536079:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.536087:0:14835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.536093:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448455.536099:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c1cc2800/0xe29566c2465fa874 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448456.346008:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789448457.306643:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448457.306652:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9d0ac8800 from 10 10000000:01000000:3.0:1789448457.306658:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448457.306801:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448457.306816:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448457.306845:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448457.306872:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448457.307011:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448457.307147:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448457.309338:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367808 00000100:00100000:1.0:1789448457.309352:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367808 00000100:00100000:1.0:1789448457.309503:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789448457.309514:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+11:14399:x1876372317367808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448457.309531:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448457.309551:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa87b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448457.309577:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa87b expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448457.309588:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa87b expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448457.309610:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34800, rc 0) 00000100:00100000:1.0:1789448457.309700:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448457.309998:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448457.310094:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448457.310113:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448457.310123:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448457.310190:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448457.310251:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448457.311538:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448457.313012:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317367936 00000100:00100000:2.0:1789448457.313026:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317367936 00000100:00100000:2.0:1789448457.313081:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448457.313091:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448457.313426:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317367936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448457.313441:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448457.313469:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317367936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448457.313530:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317368064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448457.313575:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448457.313600:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368064 00000100:00100000:3.0:1789448457.313605:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448457.313615:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368064 00000100:00100000:2.0:1789448457.313635:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789448457.313641:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317368064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448457.314055:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:14399:x1876372317368064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 413us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448457.314063:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789448457.314181:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317368064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789448457.315366:0:14897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789448457.315673:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789448457.315702:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448457.315713:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448457.315835:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448457.369719:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448458.010931:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448458.010940:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448458.010943:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448458.010946:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789448458.011009:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448458.011029:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317368192:0@lo:400:kworker.0 00000100:00100000:2.0:1789448458.011103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448458.011367:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368192 00000100:00100000:1.0:1789448458.011376:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368192 00000100:00100000:1.0:1789448458.011432:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448458.011441:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317368192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448458.011500:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317368192:12345-0@lo:400:kworker.0 Request processed in 61us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448458.011508:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789448458.012206:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9d138dc00 x1876372317368192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448458.012238:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317368192:0@lo:400:kworker.0 00000100:00100000:3.0:1789448458.012399:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448447/real 1789448447] req@ffff97d9f54ba300 x1876372317364736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448458.012431:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9f54ba300 x1876372317364736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448457 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448458.012443:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448447/real 1789448447] req@ffff97d9f54b8e00 x1876372317364608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448458.012467:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9f54b8e00 x1876372317364608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448457 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448458.012487:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448458.012507:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448458.012511:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317364736:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789448458.012519:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448458.012525:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448458.012529:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317364608:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789448458.013075:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448458.013082:0:13978:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789448458.013085:0:13978:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448458.013091:0:13978:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1789448458.013096:0:13978:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789448458.013119:0:13978:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97d9d2e64800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1789448458.013151:0:13978:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9d138dc00 x1876372317368320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789448458.013175:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448458.013179:0:13978:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789448458.013181:0:13978:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448458.013184:0:13978:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1789448458.013187:0:13978:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789448458.013192:0:13978:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9d2e64000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1789448458.013204:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317368320:0@lo:8:kworker.0 00000400:00000100:2.0:1789448458.013282:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876372317368320 offset 0 length 520: 4 00000100:00100000:2.0:1789448458.013337:0:13978:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9d138c380 x1876372317368448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448458.013509:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317368448:0@lo:8:kworker.0 00000400:00000100:3.0:1789448458.013579:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876372317368448 offset 0 length 520: 4 00010000:00010000:3.0:1789448458.395463:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448459.419024:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448459.869036:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448460.442284:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448461.471037:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789448461.762308:0:15084:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789448461.762313:0:15084:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789448461.762439:0:15084:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97d9fb0c9000 00000020:01000004:2.0:1789448461.762454:0:15084:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789448461.762466:0:15084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789448461.762500:0:15084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97d9c60fcd40) 00000020:00000080:2.0:1789448461.762518:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789448461.809561:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789448461.809967:0:15084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789448461.811046:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789448461.811406:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789448461.813012:0:15084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789448461.813653:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 691: rc = 0 00100000:10000000:2.0:1789448461.813866:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 691: rc = 0 00100000:10000000:2.0:1789448461.813976:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 691: rc = 0 00100000:10000000:2.0:1789448461.815255:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 48: rc = 0 00100000:10000000:2.0:1789448461.815544:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 48: rc = 0 00100000:10000000:2.0:1789448461.815846:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 48: rc = 0 00100000:10000000:2.0:1789448461.816109:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 48: rc = 0 00100000:10000000:2.0:1789448461.816399:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 48: rc = 0 00100000:10000000:2.0:1789448461.818996:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 48: rc = 0 00000020:00000080:2.0:1789448461.819614:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789448461.819627:0:15084:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789448461.819647:0:15084:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe29566c2465fa890 00000020:01000004:2.0:1789448461.819656:0:15084:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789448461.819679:0:15084:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789448461.819684:0:15084:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789448461.819689:0:15084:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789448461.819694:0:15084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789448461.819706:0:15084:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97d9c60f99c0) 00000020:00000080:2.0:1789448461.819715:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789448461.825911:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448461.827004:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789448461.827014:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789448461.845353:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789448461.845366:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789448461.846071:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789448461.846079:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789448461.852211:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448461.853127:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448461.853136:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789448461.863276:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789448461.863476:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789448461.909403:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448461.909667:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789448461.909676:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789448461.935340:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789448461.935362:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789448461.940087:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789448461.940103:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789448461.944962:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789448461.945170:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789448461.945176:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789448461.946429:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789448461.946438:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789448462.061429:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448462.061661:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448462.061668:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789448462.065167:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789448462.065181:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789448462.069933:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789448462.069963:0:15084:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789448462.069970:0:15084:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789448462.085773:0:15084:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789448462.085812:0:15084:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789448462.085816:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789448462.085818:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789448462.085819:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448462.085821:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448462.085822:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448462.085823:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448462.085825:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448462.085827:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448462.085828:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448462.085832:0:15084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789448462.085835:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789448462.085836:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789448462.085837:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448462.085838:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448462.085839:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448462.085840:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448462.085845:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448462.085847:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448462.085847:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448462.085873:0:15084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789448462.085898:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789448462.085971:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448462.086033:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368576 00000100:00100000:1.0:1789448462.086041:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368576 00000100:00100000:1.0:1789448462.086322:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448462.086333:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:15084:x1876372317368576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789448462.086376:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789448462.086380:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789448462.086384:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789448462.086440:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.110394:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+12:15084:x1876372317368576:12345-0@lo:253:mount.lustre.0 Request processed in 24054us (24413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448462.110410:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448462.110654:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789448462.110671:0:15084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789448462.110674:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448462.110676:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789448462.110678:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448462.110679:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448462.110680:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448462.110681:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448462.110683:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448462.110684:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448462.110685:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789448462.110707:0:15084:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97d9fb0c9000 from lustre-OST0000 10000000:01000000:1.0:1789448462.110736:0:15084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789448462.110739:0:15084:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789448462.110745:0:15084:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97d8c1968000 local copy 00010000:00010000:1.0:1789448462.110755:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448462.111176:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448462.111531:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448462.111618:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c11ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.111669:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368704 00000100:00100000:0.0:1789448462.111676:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368704 00000100:00100000:0.0:1789448462.111758:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789448462.111768:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:15084:x1876372317368704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448462.111961:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+12:15084:x1876372317368704:12345-0@lo:501:mount.lustre.0 Request processed in 194us (430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448462.111968:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789448462.112053:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368704:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789448462.112077:0:15084:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789448462.112246:0:15084:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789448462.112255:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.112265:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448462.112290:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97d9fb0c9000 10000000:01000000:2.0:1789448462.112295:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789448462.112301:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97d8c1968000 10000000:01000000:2.0:1789448462.112303:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789448462.112306:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97d8c1968000 from 1 10000000:01000000:2.0:1789448462.112309:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789448462.112335:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.112355:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.112364:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448462.112380:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448462.112409:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.117099:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31600 going to sleep for 11 seconds 00000100:00100000:1.0:1789448462.117271:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368832 00000100:00100000:1.0:1789448462.117281:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368832 00000100:00100000:1.0:1789448462.117416:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789448462.117443:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+12:15084:x1876372317368832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448462.117475:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448462.117498:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a35e00/0xe29566c2465fa8a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa89e expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.117527:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a35e00/0xe29566c2465fa8a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa89e expref: 13 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.117539:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a35e00/0xe29566c2465fa8a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa89e expref: 13 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.117549:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35e00, rc 0) 00000100:00100000:1.0:1789448462.117617:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+13:15084:x1876372317368832:12345-0@lo:101:mount.lustre.0 Request processed in 184us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448462.117625:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789448462.118800:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448462.118825:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8a5 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.118852:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa8a5 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448462.118875:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789448462.118896:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8a5 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.118905:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3e00/0xe29566c2465fa89e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8a5 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448462.118913:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789448462.118918:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448462.119031:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789448462.119034:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789448462.119067:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.119075:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.119084:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448462.119103:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448462.119149:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.119181:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31600 going to sleep for 11 seconds 00000100:00100000:1.0:1789448462.119279:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317368960 00000100:00100000:1.0:1789448462.119286:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317368960 00000100:00100000:1.0:1789448462.119315:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448462.119322:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+13:15084:x1876372317368960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448462.119334:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448462.119418:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34a00/0xe29566c2465fa8b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa8ac expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.119440:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34a00/0xe29566c2465fa8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa8ac expref: 14 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.119458:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34a00/0xe29566c2465fa8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa8ac expref: 14 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.119465:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34a00, rc 0) 00000100:00100000:1.0:1789448462.119510:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317368960:12345-0@lo:101:mount.lustre.0 Request processed in 187us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448462.119517:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789448462.120078:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317368960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448462.120091:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8b3 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.120107:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa8b3 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448462.123796:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789448462.126532:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448462.126843:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789448462.126890:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789448462.127037:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789448462.127106:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789448462.127146:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789448462.127177:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789448462.127266:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789448462.127274:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789448462.129381:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448462.129457:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.129500:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448462.129890:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369088 00000100:00100000:1.0:1789448462.129900:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369088 00000100:00100000:1.0:1789448462.129974:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448462.129983:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448462.130628:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369088:12345-0@lo:501:mount.lustre.0 Request processed in 644us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448462.130648:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789448462.130703:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448462.130804:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448462.130883:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.130928:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.131754:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369216 00000100:00100000:2.0:1789448462.131764:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369216 00000100:00100000:2.0:1789448462.131804:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789448462.131811:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448462.136766:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369216:12345-0@lo:503:mount.lustre.0 Request processed in 4948us (5877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.136781:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789448462.139000:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789448462.142442:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789448462.142580:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448462.142718:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.142793:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.143737:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369344 00000100:00100000:2.0:1789448462.143753:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369344 00000100:00100000:2.0:1789448462.143827:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789448462.143839:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.144286:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369344:12345-0@lo:502:mount.lustre.0 Request processed in 449us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.144294:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789448462.144693:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789448462.145577:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789448462.145800:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789448462.145891:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789448462.147459:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789448462.147577:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789448462.147623:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789448462.147707:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789448462.147744:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789448462.147779:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789448462.147823:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789448462.147861:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789448462.147935:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789448462.148029:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448462.150372:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.150430:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448462.150464:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369472 00000100:00100000:1.0:1789448462.150480:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369472 00000100:00100000:1.0:1789448462.150542:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448462.150553:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448462.150838:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369472:12345-0@lo:502:mount.lustre.0 Request processed in 288us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448462.150847:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789448462.152087:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448462.152594:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789448462.152615:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789448462.154795:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789448462.154808:0:15110:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789448462.154815:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448462.154817:0:15110:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789448462.154824:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789448462.154838:0:15110:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97d9c60fb380) 00000020:00000080:2.0:1789448462.154860:0:15110:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789448462.154865:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789448462.155492:0:15110:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9fb0c9000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789448462.155502:0:15110:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789448462.155513:0:15110:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe29566c2465fa8c1 00010000:00010000:2.0:1789448462.163668:0:15110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789448462.164168:0:15110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789448462.167551:0:15110:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789448462.170174:0:15110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789448462.170188:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.170194:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.170196:0:15110:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789448462.170207:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789448462.170210:0:15110:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789448462.170212:0:15110:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448462.170213:0:15110:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448462.170251:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789448462.170255:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.170256:0:15110:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789448462.170259:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448462.170262:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.170263:0:15110:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789448462.170266:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789448462.170267:0:15110:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789448462.170269:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.170271:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.170273:0:15110:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789448462.170274:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448462.170277:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.170278:0:15110:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789448462.170281:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789448462.171026:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.171033:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.171034:0:15110:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789448462.171040:0:15110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789448462.171104:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789448462.171143:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789448462.171163:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8b3 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.171176:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3400/0xe29566c2465fa8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8b3 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448462.171198:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9fb0c9000 from 1 10000000:01000000:0.0:1789448462.171201:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448462.171260:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.171276:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.171290:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448462.171320:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448462.172102:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448462.172158:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369600 00000100:00100000:0.0:1789448462.172167:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369600 00000100:00100000:0.0:1789448462.172244:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448462.172254:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+14:15084:x1876372317369600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448462.172268:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448462.172285:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa8c8 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.172309:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 15 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.172319:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 15 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.172327:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33e00, rc 0) 00000100:00100000:0.0:1789448462.173167:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369600:12345-0@lo:101:mount.lustre.0 Request processed in 910us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448462.173177:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448462.173265:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1084cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.173297:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448462.173316:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.173326:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448462.180171:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789448462.185674:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448462.185963:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789448462.186024:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789448462.186090:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789448462.186098:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789448462.186190:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448462.186296:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.186491:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369728 00000100:00100000:2.0:1789448462.186499:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369728 00000100:00100000:2.0:1789448462.186550:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789448462.186559:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448462.186786:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369728:12345-0@lo:501:mount.lustre.0 Request processed in 227us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.186794:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448462.186850:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1084cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.186873:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448462.186902:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448462.186992:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448462.187022:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369856 00000100:00100000:0.0:1789448462.187026:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369856 00000100:00100000:0.0:1789448462.187456:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448462.187466:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448462.187611:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369856:12345-0@lo:503:mount.lustre.0 Request processed in 146us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448462.187617:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789448462.195334:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1084cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.195382:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448462.195937:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448462.196012:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.196086:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.196124:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448462.196205:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317369984 00000100:00100000:3.0:1789448462.196240:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317369984 00000100:00100000:3.0:1789448462.196307:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448462.196320:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448462.196621:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317369984:12345-0@lo:502:mount.lustre.0 Request processed in 303us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.196630:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789448462.199534:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317369984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448462.199831:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789448462.199893:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789448462.199945:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789448462.199981:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789448462.200014:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789448462.200074:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789448462.200109:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789448462.200139:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789448462.200180:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.200332:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.205121:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.205827:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370112 00000100:00100000:0.0:1789448462.205854:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370112 00000100:00100000:0.0:1789448462.205917:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789448462.205937:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317370112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448462.206206:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317370112:12345-0@lo:502:mount.lustre.0 Request processed in 270us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448462.206278:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789448462.208939:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448462.209129:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789448462.209144:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789448462.212329:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448462.212409:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.212413:0:15115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789448462.212421:0:15115:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9fb0c9000 00000020:00000080:0.0:1789448462.212424:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448462.212431:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.212433:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.212435:0:15115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789448462.212437:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448462.212440:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.212441:0:15115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789448462.212445:0:15115:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97d9fb0c9000 00000020:00000080:0.0:1789448462.212448:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448462.212589:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.212595:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.212597:0:15115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789448462.212600:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448462.212603:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.212604:0:15115:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789448462.212608:0:15115:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97d9fb0c9000 00000020:00000080:0.0:1789448462.212610:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448462.231837:0:15115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448462.231856:0:15115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448462.231859:0:15115:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789448462.231864:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789448462.232161:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789448462.232190:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448462.232214:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232248:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448462.232300:0:15084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789448462.232304:0:15084:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97d9fb0c9000 10000000:01000000:2.0:1789448462.232307:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97d9fb0c9000 10000000:01000000:2.0:1789448462.232311:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448462.232317:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97d9fb0c9000 from 1 10000000:01000000:2.0:1789448462.232326:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789448462.232363:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232372:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232383:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448462.232408:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448462.232478:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.232517:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370240 00000100:00100000:2.0:1789448462.232523:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370240 00000100:00100000:2.0:1789448462.232561:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448462.232569:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317370240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448462.232581:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448462.232593:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c1cc2e00/0xe29566c2465fa8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa8d6 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232616:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c1cc2e00/0xe29566c2465fa8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa8d6 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232627:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c1cc2e00/0xe29566c2465fa8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa8d6 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232646:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c1cc2e00, rc 0) 00000100:00100000:2.0:1789448462.232679:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370240:12345-0@lo:101:mount.lustre.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.232685:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448462.232733:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.232753:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448462.232768:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8dd expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448462.232776:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa8dd expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448462.234449:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789448462.234789:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448462.236609:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789448462.236696:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789448462.236746:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789448462.236797:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789448462.236833:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789448462.236883:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789448462.243565:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789448462.243744:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789448462.243823:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789448462.243861:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789448462.243896:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789448462.243961:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789448462.243998:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789448462.244033:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789448462.244082:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789448462.244118:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789448462.244153:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789448462.244200:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789448462.244287:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789448462.244323:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789448462.244375:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789448462.244411:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789448462.244457:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789448462.244521:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789448462.244560:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789448462.244594:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789448462.244651:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789448462.244688:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789448462.244775:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789448462.244783:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789448462.244885:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448462.244951:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.245002:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448462.249062:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370368 00000100:00100000:3.0:1789448462.249077:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370368 00000100:00100000:3.0:1789448462.249126:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789448462.249135:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448462.249461:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370368:12345-0@lo:501:mount.lustre.0 Request processed in 327us (4509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.249470:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789448462.249617:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448462.249679:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448462.249723:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.249761:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.250034:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370496 00000100:00100000:2.0:1789448462.250040:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370496 00000100:00100000:2.0:1789448462.250076:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448462.250083:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448462.250246:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370496:12345-0@lo:503:mount.lustre.0 Request processed in 163us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.250253:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448462.250297:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370496:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448462.252264:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448462.252350:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.252417:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.252462:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370624 00000100:00100000:2.0:1789448462.252469:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370624 00000100:00100000:2.0:1789448462.252508:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789448462.252516:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.252727:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370624:12345-0@lo:502:mount.lustre.0 Request processed in 211us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.252734:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789448462.252784:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.252803:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448462.253051:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789448462.253101:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789448462.253149:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789448462.253210:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789448462.253278:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789448462.253343:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789448462.253384:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789448462.253418:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789448462.253466:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789448462.253504:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789448462.253539:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789448462.253587:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789448462.253617:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789448462.253660:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789448462.253709:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789448462.253746:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789448462.253778:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789448462.253825:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789448462.253876:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789448462.253909:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789448462.253957:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789448462.254003:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789448462.254035:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789448462.254094:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789448462.254133:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789448462.254166:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789448462.254239:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789448462.254280:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789448462.254313:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789448462.254361:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789448462.254397:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789448462.254432:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789448462.254466:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789448462.254517:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789448462.254568:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789448462.254617:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789448462.263729:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789448462.263795:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789448462.263875:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789448462.263919:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789448462.265497:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448462.265590:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448462.266042:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9fb09f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448462.275867:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370752 00000100:00100000:2.0:1789448462.275879:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370752 00000100:00100000:2.0:1789448462.276476:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448462.276490:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448462.276802:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317370752:12345-0@lo:502:mount.lustre.0 Request processed in 316us (11211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448462.276810:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789448462.278851:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317370752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448462.279008:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789448462.279031:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789448462.280307:0:15120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789448462.280323:0:15120:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97d9f54d3380) 00000020:00000080:3.0:1789448462.280917:0:15120:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789448462.281045:0:15120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97d9fb0c9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789448462.281049:0:15120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97d9fb0c9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789448462.281052:0:15120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97d9fb0c9000 3 00010000:00080000:3.0:1789448462.281080:0:15120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9eadb6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789448462.283567:0:15120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789448462.283817:0:15120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789448462.283855:0:15120:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789448462.283878:0:15120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe29566c2465fa8eb 00000100:00080000:3.0:1789448462.283888:0:15120:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448462.283900:0:15120:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97d9eadb6800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789448462.283940:0:15120:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9f54b8e00 x1876372317370880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448462.283965:0:15120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789448462.284001:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448462.284005:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448462.284008:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448462.284011:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448462.284051:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448462.284063:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317371008:0@lo:400:kworker.0 00000100:00100000:3.0:1789448462.284121:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.284167:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371008 00000100:00100000:3.0:1789448462.284174:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371008 00000100:00100000:3.0:1789448462.284211:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448462.284241:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317371008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448462.284305:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317371008:12345-0@lo:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.284312:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789448462.284345:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9f54ba300 x1876372317371008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448462.284358:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317371008:0@lo:400:kworker.0 00000100:00100000:2.0:1789448462.284868:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317370880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448462.284904:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.289862:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317370880 00000100:00100000:3.0:1789448462.289879:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317370880 00000100:00100000:3.0:1789448462.289921:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448462.289930:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876372317370880:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789448462.289959:0:14404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1789448462.289995:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe29566c2465fa8f2 00000004:00100000:3.0:1789448462.290011:0:14404:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789448462.290042:0:14404:0:(import.c:65:import_set_state_nolock()) ffff97d8c2239000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448462.290128:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876372317370880:12345-0@lo:38:llog_process_th.0 Request processed in 198us (5222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.290136:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789448462.290188:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97d9f54b8e00 x1876372317370880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448462.290200:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448462.290208:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789448462.290239:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789448462.290245:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789448462.290248:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9eadb6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789448462.290255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876372317370880:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789448462.291777:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789448462.294086:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789448462.294122:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448462.294178:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8dd expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.294192:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3a00/0xe29566c2465fa8d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa8dd expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789448462.294556:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789448462.294559:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448462.294561:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448462.294562:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448462.294564:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448462.294565:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448462.294567:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448462.294569:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448462.294576:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789448462.294580:0:15084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789448462.294582:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448462.294583:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448462.294584:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448462.294585:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448462.294586:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448462.294587:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448462.294588:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448462.294589:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448462.294590:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789448462.294615:0:15084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789448462.294645:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317371136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448462.294782:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448462.294826:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef039480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448462.294873:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371136 00000100:00100000:3.0:1789448462.294880:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371136 00000100:00100000:3.0:1789448462.294936:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789448462.294946:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:15084:x1876372317371136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789448462.294983:0:14396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789448462.295000:0:14396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789448462.331505:0:14396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789448462.331523:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789448462.332910:0:14418:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789448462.332919:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789448462.332941:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.332962:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa85f expref: 16 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.332971:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.333012:0:14418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 16 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.333027:0:14418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 16 pid: 14397 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448462.333042:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317371264:0@lo:104: 00000100:00100000:3.0:1789448462.333106:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.333147:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448462.333478:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371264 00000100:00100000:0.0:1789448462.333487:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371264 00000100:00100000:0.0:1789448462.333539:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448462.333549:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317371264:12345-0@lo:104: 00010000:00010000:0.0:1789448462.333563:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333641:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448462.333648:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317371264:12345-0@lo:104: Request processed in 100us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448462.333655:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789448462.333688:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448462.333694:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333702:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:0.0:1789448462.333706:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333731:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448462.333739:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448462.333745:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448462.333776:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333782:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448462.333799:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333806:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465fa85f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa866 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448462.333821:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448462.333823:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448462.333825:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448462.333832:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448462.333844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317371392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448462.333873:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448462.334070:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317371264:0@lo:104: 00010000:00010000:3.0:1789448462.334091:0:14418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448462.334120:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371392 00000100:00100000:3.0:1789448462.334124:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371392 00010000:00010000:3.0:1789448462.334141:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 17 pid: 14397 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448462.334170:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448462.334178:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+17:3306:x1876372317371392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448462.334196:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448462.334201:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 17 pid: 14397 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334211:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 17 pid: 14397 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334260:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fad27000/0xe29566c2465fa866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa85f expref: 17 pid: 14397 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334272:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334279:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789448462.334292:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001584308s 00010000:00010000:3.0:1789448462.334297:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334304:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334311:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334317:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334322:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448462.334326:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334440:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334462:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448462.334472:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448462.334509:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+16:3306:x1876372317371392:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.334516:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448462.334542:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317371392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448462.334599:0:14418:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.334607:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448462.334615:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fad26a00/0xe29566c2465fa8f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448462.339994:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+15:15084:x1876372317371136:12345-0@lo:253:mount.lustre.0 Request processed in 45038us (45201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448462.340011:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789448462.340141:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15084:1876372317371136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789448462.340158:0:15084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789448462.340161:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789448462.340163:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448462.340164:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448462.340166:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448462.340167:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448462.340168:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448462.340169:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448462.340171:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448462.340172:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789448462.340184:0:15084:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789448462.344716:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448462.344886:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789448462.345039:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789448462.345182:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789448462.345709:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448462.345921:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789448462.346723:0:15084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789448462.402501:0:15084:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789448462.402510:0:15084:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789448462.402544:0:15084:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789448462.402616:0:15084:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789448462.402645:0:15084:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789448462.402740:0:15084:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789448462.489414:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448463.513866:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789448463.646606:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789448463.646613:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9d0ac8800 from 7 10000000:01000000:1.0:1789448463.646618:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789448463.646691:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448463.646705:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448463.646718:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448463.646743:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317371520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448463.646810:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448463.646866:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448463.647185:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371520 00000100:00100000:0.0:1789448463.647194:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371520 00000100:00100000:0.0:1789448463.647278:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789448463.647288:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+15:14399:x1876372317371520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448463.647301:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448463.647316:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa900 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448463.647338:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa900 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448463.647349:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa900 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448463.647359:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32e00, rc 0) 00000100:00100000:0.0:1789448463.647405:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:14399:x1876372317371520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448463.647411:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789448463.647463:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317371520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448463.647476:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448463.647485:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448463.647535:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317371648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789448463.647570:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448463.647592:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371648 00000100:00100000:0.0:1789448463.647596:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371648 00000100:00100000:0.0:1789448463.647618:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448463.647637:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:14399:x1876372317371648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789448463.647658:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789448463.647675:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789448463.647678:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789448463.647746:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:14399:x1876372317371648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448463.647754:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448463.647776:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448463.647786:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317371648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789448463.647838:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448463.647843:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448463.647850:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448464.543142:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448465.562814:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448466.600422:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448467.609435:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448467.742060:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67d9a8de-e7f1-4030-af60-fc835c982539:3304:1876372317371776:0@lo:400:kworker.0 00000100:00100000:3.0:1789448467.742134:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789448467.742209:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448467.742238:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448467.742241:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448467.742243:0:13978:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789448467.742309:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371776 00000100:00100000:0.0:1789448467.742318:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371776 00000100:00100000:0.0:1789448467.742361:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789448467.742370:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3304:x1876372317371776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448467.749254:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317371904:0@lo:400:kworker.0 00000100:00100000:1.0:1789448467.749331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448467.749402:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317371904 00000100:00100000:1.0:1789448467.749411:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317371904 00000100:00100000:1.0:1789448467.749457:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448467.749465:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317371904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448467.749520:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317371904:12345-0@lo:400:kworker.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448467.749528:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789448467.749569:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9d138df80 x1876372317371904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448467.749595:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317371904:0@lo:400:kworker.0 00000100:00100000:2.0:1789448467.750510:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317372032:0@lo:400:kworker.0 00000100:00100000:2.0:1789448467.750564:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448467.750622:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372032 00000100:00100000:2.0:1789448467.750627:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372032 00000100:00100000:2.0:1789448467.750664:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448467.750672:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317372032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448467.750710:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317372032:12345-0@lo:400:kworker.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448467.750717:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789448467.750747:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9d138c700 x1876372317372032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448467.750758:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317372032:0@lo:400:kworker.0 00000100:00080000:1.0:1789448467.752755:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448467.758119:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3304:x1876372317371776:12345-0@lo:400:kworker.0 Request processed in 15741us (15976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448467.758154:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789448467.768041:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67d9a8de-e7f1-4030-af60-fc835c982539:3304:1876372317371776:0@lo:400:kworker.0 00010000:00010000:2.0:1789448468.637064:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448469.083044:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789448469.093354:0:15464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789448469.660097:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448470.686620:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448471.718043:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448472.732067:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448472.871152:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1789448472.872140:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448472.872147:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448472.872151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448472.872154:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448472.872470:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317372288:0@lo:400:kworker.0 00000100:00100000:3.0:1789448472.872568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448472.872651:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448472.872658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317372416:0@lo:400:kworker.0 00000100:00100000:3.0:1789448472.872683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448472.872917:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372288 00000100:00100000:3.0:1789448472.872927:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372288 00000100:00100000:3.0:1789448472.872981:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372416 00000100:00100000:3.0:1789448472.872984:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372416 00000100:00100000:3.0:1789448472.877869:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448472.877887:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317372288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448472.878019:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317372288:12345-0@lo:400:kworker.0 Request processed in 136us (5450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448472.878028:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448472.878048:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448472.878055:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317372416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448472.878085:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317372416:12345-0@lo:400:kworker.0 Request processed in 32us (5401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448472.878092:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789448472.878155:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9f54bbb80 x1876372317372416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448472.878175:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317372416:0@lo:400:kworker.0 00010000:00080000:3.0:1789448472.878190:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9f54bb800 x1876372317372288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448472.878200:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317372288:0@lo:400:kworker.0 00000100:00080000:1.0:1789448472.879806:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448472.883858:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317372160:0@lo:400:kworker.0 00000100:00100000:0.0:1789448472.883970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448472.884485:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372160 00000100:00100000:1.0:1789448472.884497:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372160 00000100:00100000:1.0:1789448472.884671:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789448472.884687:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:3306:x1876372317372160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448472.884773:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:3306:x1876372317372160:12345-0@lo:400:kworker.0 Request processed in 90us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448472.884780:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789448472.885163:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317372160:0@lo:400:kworker.0 00000100:00100000:3.0:1789448473.561358:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448458/real 1789448458] req@ffff97d9d138c380 x1876372317368448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448473.561414:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9d138c380 x1876372317368448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448473.561424:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448458/real 1789448458] req@ffff97d9d138dc00 x1876372317368320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448473.561437:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97d9d138dc00 x1876372317368320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448473.561454:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448473.561488:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448473.561492:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317368448:0@lo:8:kworker.0 00000100:00080000:3.0:1789448473.561498:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448473.561504:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448473.561507:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317368320:0@lo:8:kworker.0 00000100:00080000:1.0:1789448473.561645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448473.561649:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789448473.561657:0:37:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448473.561662:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1789448473.561667:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789448473.561676:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97d9d2e64800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448473.561711:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fd9500 x1876372317372672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448473.561735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448473.561738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789448473.561740:0:37:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448473.561742:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1789448473.561745:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789448473.561749:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9d2e64000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448473.561761:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fd8380 x1876372317372800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448473.561801:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448473.561813:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317373056:0@lo:400:kworker.0 00000100:00100000:2.0:1789448473.561837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317372544:0@lo:400:kworker.0 00000100:00100000:3.0:1789448473.561990:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317372928:0@lo:400:kworker.0 00000100:00100000:2.0:1789448473.565926:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448473.566050:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372544 00000100:00100000:2.0:1789448473.566061:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372544 00000100:00100000:2.0:1789448473.566118:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789448473.566130:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3306:x1876372317372544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448473.566190:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3306:x1876372317372544:12345-0@lo:400:kworker.0 Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448473.566207:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448473.566208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448473.566257:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372928 00000100:00100000:3.0:1789448473.566261:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372928 00000100:00100000:3.0:1789448473.566290:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448473.566291:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317372544:0@lo:400:kworker.0 00000100:00100000:3.0:1789448473.566295:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317372928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448473.566330:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876372317372928:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448473.566336:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789448473.566355:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fda300 x1876372317372928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448473.566368:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876372317372928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448473.567786:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317372672:0@lo:8:kworker.0 00000100:00100000:0.0:1789448473.567844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448473.567884:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317372800:0@lo:8:kworker.0 00000100:00100000:0.0:1789448473.567906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448473.568191:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372672 00000100:00100000:3.0:1789448473.568198:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372672 00000100:00100000:3.0:1789448473.568273:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317372800 00000100:00100000:3.0:1789448473.568277:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317372800 00000100:00100000:3.0:1789448473.568289:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448473.568296:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317372672:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789448473.568323:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1789448473.568354:0:15087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465fa90e 00002000:00100000:3.0:1789448473.568368:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97d8c223a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789448473.568372:0:15087:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789448473.568375:0:15087:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789448473.568714:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789448473.568739:0:15087:0:(import.c:65:import_set_state_nolock()) ffff97d8c223d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448473.568808:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876372317372672:12345-0@lo:8:kworker.0 Request processed in 511us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448473.568815:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448473.568830:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448473.568834:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317372800:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789448473.568844:0:15087:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789448473.568870:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317372800:12345-0@lo:8:kworker.0 Request processed in 34us (962us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789448473.568875:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448473.569011:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fd9500 x1876372317372672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448473.569021:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789448473.569029:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789448473.569075:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789448473.569081:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789448473.569084:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789448473.571271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448473.571505:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373056 00000100:00100000:1.0:1789448473.571514:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373056 00000100:00100000:1.0:1789448473.571573:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448473.571582:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317373056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448473.571643:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317373056:12345-0@lo:400:kworker.0 Request processed in 63us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448473.571650:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789448473.571917:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fdb100 x1876372317373056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448473.571943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317373056:0@lo:400:kworker.0 00000004:00080000:1.0:1789448473.572390:0:14425:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789448473.572412:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14425:1876372317373312:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789448473.572457:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448473.572484:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789448473.572496:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448473.572505:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317373184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448473.572527:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448473.572600:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373184 00000100:00100000:1.0:1789448473.572605:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373184 00000100:00100000:1.0:1789448473.572640:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448473.572647:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317373184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448473.572677:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789448473.572917:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317373184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 269us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448473.572924:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789448473.572941:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789448473.572965:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fdb100 x1876372317373184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448473.572982:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317373184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448473.574422:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373312 00000100:00100000:3.0:1789448473.574434:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373312 00000100:00100000:3.0:1789448473.574491:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448473.574500:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14425:x1876372317373312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789448473.576946:0:15087:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789448473.576958:0:15087:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789448473.576963:0:15087:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000004:00080000:0.0:1789448473.577720:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789448473.577735:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317372672:0@lo:8:kworker.0 00000100:00080000:0.0:1789448473.577907:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789448473.577912:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789448473.577916:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317372800:0@lo:8:kworker.0 00000004:00080000:2.0:1789448473.578448:0:14424:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789448473.578725:0:14424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 495281506339ns, next at 0ns, rc = 0 00002000:00010000:3.0:1789448473.591623:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.591635:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.591652:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.591656:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.591662:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.591678:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.591689:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.591697:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.591722:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448473.591805:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448473.591812:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.591820:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.591830:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.591839:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.591856:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.591864:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7aa55e/0xe29566c2465fa915 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.591882:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.591884:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.591886:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.594607:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.594621:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.594636:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.594640:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.594645:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.594668:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.594677:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.594684:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.594732:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.595196:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.595204:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.595234:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.595238:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.595243:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.595253:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.595261:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.595279:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597696:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448473.597710:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597726:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.597731:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597743:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597767:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597776:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fa91c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597797:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.597807:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597814:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.597817:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597824:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597834:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.597842:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.597844:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.597846:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.599625:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448473.599638:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa923 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.599692:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.601433:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.601444:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.602979:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.602984:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.602991:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603007:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603019:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603027:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603068:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.603629:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.603637:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603648:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.603651:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.603656:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603665:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603674:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603681:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.603702:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448473.604068:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448473.604076:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604084:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.604089:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604098:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604115:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604130:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fa92a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604148:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.604151:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604158:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.604162:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604169:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604179:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604186:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa931 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.604196:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.604197:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.604199:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.605432:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.605446:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.605462:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.605473:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.605480:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.605492:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.605502:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.605509:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.607727:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.610408:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.610420:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.610438:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.610444:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.610450:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.610465:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.610477:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.610492:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610620:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448473.610629:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610643:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.610648:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610658:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610676:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610684:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610703:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.610707:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610713:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.610716:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610724:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610734:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.610748:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.610750:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.610752:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.614792:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448473.614807:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa93f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.614966:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.615866:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.615876:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.615893:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.615898:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.615905:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.615923:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.615934:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.615944:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.615958:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789448473.616380:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.616386:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616407:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.616411:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.616415:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616424:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616432:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616439:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616457:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448473.616469:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448473.616474:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616481:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.616486:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616494:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616521:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616538:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005847b5bf/0xe29566c2465fa946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616554:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.616557:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616564:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.616567:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616574:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616583:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616590:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b98ac29/0xe29566c2465fa94d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.616599:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.616601:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.616608:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.616985:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.616992:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617000:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.617004:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.617008:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617016:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617024:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617031:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617044:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.617051:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.617055:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617061:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.617065:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617084:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617095:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617102:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90245d6/0xe29566c2465fa954 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617117:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.617118:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.617120:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.617539:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.617547:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617556:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.617559:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.617562:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617571:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617579:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617592:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617606:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.617615:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.617619:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617626:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.617629:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617637:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617648:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617655:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8cc56e/0xe29566c2465fa95b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.617667:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.617669:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.617671:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.618055:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.618067:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618076:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.618079:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.618084:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618093:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618101:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618108:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618122:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.618131:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.618135:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618142:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.618145:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618153:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618169:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618177:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebc29415/0xe29566c2465fa962 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.618190:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.618192:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.618194:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.623283:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.623296:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.623805:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.623818:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.623837:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.623842:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.623849:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624644:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624656:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624664:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624692:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.624704:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.624709:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624717:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.624722:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624731:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624749:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624756:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6447da/0xe29566c2465fa969 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.624775:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.624777:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.624779:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.628400:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.628413:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628430:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.628442:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.628449:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628464:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628475:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628482:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628504:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.628517:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.628523:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628543:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.628547:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628556:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628571:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628590:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000873bf1d3/0xe29566c2465fa970 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.628609:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.628611:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.628612:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.630598:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.630612:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.630628:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.630633:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.630640:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.630654:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.630664:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.630673:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.630697:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789448473.631115:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.631126:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631134:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.631137:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.631141:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631150:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631157:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631164:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631181:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448473.631194:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448473.631199:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631206:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc2400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.631210:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631244:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631267:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631274:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f13609c6/0xe29566c2465fa977 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631292:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.631296:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631302:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c1cc3000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.631306:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631313:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631323:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.631483:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.631652:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a83a56/0xe29566c2465fa97e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.631669:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.631671:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.631678:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448473.632186:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789448473.632192:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.632203:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789448473.632206:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448473.632212:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.632682:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.632692:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.632700:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634364:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448473.634386:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448473.634394:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634406:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130be00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448473.634411:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634422:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634442:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634449:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031c13fb5/0xe29566c2465fa985 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.634480:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.634482:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.634484:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.635092:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.635100:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635112:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.635116:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.635122:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635134:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635143:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635150:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635171:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.635584:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.635589:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635607:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.635611:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.635615:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635625:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635633:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635640:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635655:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789448473.635668:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448473.635672:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635681:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448473.635685:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635693:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635720:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635728:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa98c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635743:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448473.635747:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635754:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448473.635757:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635764:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635773:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635781:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa993 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.635791:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.635793:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.635799:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.636197:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.636202:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636210:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.636213:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.636242:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636251:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636258:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636265:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636278:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448473.636286:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448473.636289:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636296:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448473.636299:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636316:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636327:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636334:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa99a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.636346:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.636347:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.636349:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.641586:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.643789:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.643801:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.643819:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.643824:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.643832:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.643847:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.643870:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.643892:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.643908:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.644415:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.644422:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.644431:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.644434:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.644439:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.644447:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.644455:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.644462:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.644477:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789448473.645738:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448473.645750:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645763:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.645768:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645778:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645814:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645823:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006409ae69/0xe29566c2465fa9a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645860:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448473.645865:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645872:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.645875:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645883:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645893:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645900:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee50e02/0xe29566c2465fa9a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.645914:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.645916:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.645923:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.646066:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.647849:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.647941:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.647957:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.647962:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.647968:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.647982:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.647993:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.648000:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.650408:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.651310:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.651320:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.651337:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.651342:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.651349:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.651363:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.651381:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.651390:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789448473.651474:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789448473.655336:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448473.655353:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655368:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.655374:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655387:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655410:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655418:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000efb7655/0xe29566c2465fa9af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655445:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448473.655449:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655456:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.655459:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655467:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655488:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.655496:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.655498:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.655500:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.655837:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.656026:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448473.656034:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8c2579/0xe29566c2465fa9b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448473.656710:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.656718:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.656731:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.656735:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.656741:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.656753:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.656762:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.658372:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.658927:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448473.662266:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.662277:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.662294:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.662299:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.662306:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.662322:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.662333:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.662341:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662409:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448473.662418:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662426:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.662431:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662440:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662457:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662464:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbfa966/0xe29566c2465fa9bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662483:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448473.662486:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662506:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448473.662509:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662517:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662539:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448473.662548:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.662550:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448473.662552:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.662659:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448473.662664:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eac430b/0xe29566c2465fa9c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448473.663296:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.663304:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.663314:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.663318:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.663323:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.663333:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.663342:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.663350:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.664185:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.664196:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.664206:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.664211:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.664261:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.664278:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.664287:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.664289:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.664291:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448473.666364:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448473.666376:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2f218/0xe29566c2465fa9cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.667561:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448473.669735:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789448473.669750:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.669779:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789448473.669784:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448473.669791:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.669807:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.669818:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.669825:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448473.669849:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448473.670393:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448473.670401:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.670411:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448473.670416:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.670425:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.670443:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.670451:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c74eb8d/0xe29566c2465fa9d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448473.670486:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.670488:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448473.670490:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789448473.672840:0:15087:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1789448473.673253:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14425:x1876372317373312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98750us (100791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448473.673263:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448473.673419:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14425:1876372317373312:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789448473.673436:0:14425:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789448473.673503:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14425:1876372317373440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789448473.673550:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448473.673719:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789448473.673861:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373440 00000100:00100000:3.0:1789448473.673869:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373440 00000100:00100000:3.0:1789448473.673913:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448473.673922:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14425:x1876372317373440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789448473.673966:0:15086:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789448473.689482:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14425:x1876372317373440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15553us (15923us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789448473.689498:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448473.689705:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14425:1876372317373440:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789448473.689730:0:14425:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789448473.761343:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448474.779884:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448475.804145:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789448476.537565:0:15814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789448476.537570:0:15814:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789448476.537700:0:15814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97da01b5c000 00000020:01000004:0.0:1789448476.537717:0:15814:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789448476.537729:0:15814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789448476.537745:0:15814:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97d9ceaa99c0) 00000020:00000080:0.0:1789448476.537766:0:15814:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789448476.566453:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789448476.570202:0:15814:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789448476.571521:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789448476.571999:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789448476.572205:0:15814:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789448476.575935:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 651: rc = 0 00100000:10000000:3.0:1789448476.576039:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 651: rc = 0 00100000:10000000:3.0:1789448476.576139:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 651: rc = 0 00100000:10000000:3.0:1789448476.579430:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 387: rc = 0 00100000:10000000:3.0:1789448476.579763:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 387: rc = 0 00100000:10000000:3.0:1789448476.580030:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 387: rc = 0 00100000:10000000:3.0:1789448476.580335:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 387: rc = 0 00100000:10000000:3.0:1789448476.580591:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 387: rc = 0 00100000:10000000:3.0:1789448476.580827:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 387: rc = 0 00000020:00000080:3.0:1789448476.581415:0:15814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789448476.581427:0:15814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789448476.581437:0:15814:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe29566c2465fa9e0 00000020:01000004:3.0:1789448476.581443:0:15814:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789448476.581463:0:15814:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789448476.581466:0:15814:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789448476.581471:0:15814:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789448476.581489:0:15814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789448476.581492:0:15814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789448476.627487:0:15814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789448476.627538:0:15814:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789448476.627543:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789448476.627545:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448476.627546:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448476.627547:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448476.627549:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448476.627550:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448476.627551:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448476.627554:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448476.627555:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448476.627560:0:15814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789448476.627562:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448476.627563:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448476.627564:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448476.627565:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448476.627566:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448476.627567:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448476.627568:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448476.627569:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448476.627570:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448476.627610:0:15814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789448476.627633:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448476.628511:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448476.628575:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c85e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448476.628674:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373568 00000100:00100000:1.0:1789448476.628684:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373568 00000100:00100000:1.0:1789448476.628750:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789448476.628759:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15814:x1876372317373568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789448476.628790:0:14395:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789448476.628793:0:14395:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789448476.628807:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789448476.649333:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15814:x1876372317373568:12345-0@lo:253:mount.lustre.0 Request processed in 20564us (20822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.649368:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789448476.650085:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789448476.650103:0:15814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789448476.650106:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448476.650108:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789448476.650109:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448476.650111:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448476.650112:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448476.650113:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448476.650115:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448476.650116:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448476.650117:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789448476.650140:0:15814:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97da01b5c000 from lustre-OST0001 10000000:01000000:0.0:1789448476.650173:0:15814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789448476.650176:0:15814:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789448476.650184:0:15814:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97d8c1968000 local copy 00010000:00010000:0.0:1789448476.650195:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448476.650511:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448476.650865:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.650910:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448476.653191:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373696 00000100:00100000:1.0:1789448476.653206:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373696 00000100:00100000:1.0:1789448476.653331:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789448476.653342:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:15814:x1876372317373696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.653993:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+16:15814:x1876372317373696:12345-0@lo:501:mount.lustre.0 Request processed in 652us (3126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789448476.654003:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789448476.654187:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373696:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789448476.654213:0:15814:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789448476.654431:0:15814:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789448476.654440:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.654451:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c1cc3200/0xe29566c2465fa786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa78d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448476.654477:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97da01b5c000 10000000:01000000:0.0:1789448476.654482:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789448476.654489:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789448476.654491:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448476.654497:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789448476.654510:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789448476.657033:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.657051:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.657064:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448476.657095:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448476.657169:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.657247:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.659601:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373824 00000100:00100000:2.0:1789448476.659616:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373824 00000100:00100000:2.0:1789448476.659687:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789448476.659697:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:15814:x1876372317373824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448476.659713:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448476.659732:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c130ae00/0xe29566c2465fa9ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fa9e7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.659763:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c130ae00/0xe29566c2465fa9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fa9e7 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.659774:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c130ae00/0xe29566c2465fa9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa9e7 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.659784:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130ae00, rc 0) 00000100:00100000:2.0:1789448476.659870:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317373824:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.659877:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448476.660126:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448476.660145:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa9ee expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.660155:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fa9ee expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448476.660828:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789448476.661616:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448476.661831:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789448476.661873:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789448476.661905:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789448476.661951:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789448476.661987:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789448476.662020:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789448476.662081:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789448476.662088:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789448476.662160:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.662210:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.662277:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.662432:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317373952 00000100:00100000:2.0:1789448476.662440:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317373952 00000100:00100000:2.0:1789448476.662481:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789448476.662489:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317373952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448476.662885:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317373952:12345-0@lo:501:mount.lustre.0 Request processed in 395us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.662893:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789448476.662981:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317373952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448476.663028:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448476.663072:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.663105:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.663174:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374080 00000100:00100000:2.0:1789448476.663185:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374080 00000100:00100000:2.0:1789448476.663245:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789448476.663253:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448476.663589:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374080:12345-0@lo:503:mount.lustre.0 Request processed in 336us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.663598:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448476.664076:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789448476.664753:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448476.664823:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448476.664895:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.664940:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448476.665179:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374208 00000100:00100000:1.0:1789448476.665192:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374208 00000100:00100000:1.0:1789448476.665268:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789448476.665278:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448476.665481:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374208:12345-0@lo:502:mount.lustre.0 Request processed in 204us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448476.665489:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448476.665643:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448476.665859:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789448476.665906:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789448476.665939:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789448476.665989:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789448476.666026:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789448476.666056:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789448476.666462:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789448476.666509:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789448476.666568:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789448476.666604:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448476.666652:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.666691:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448476.666709:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374336 00000100:00100000:3.0:1789448476.666717:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374336 00000100:00100000:3.0:1789448476.666769:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789448476.666779:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448476.666979:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374336:12345-0@lo:502:mount.lustre.0 Request processed in 201us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448476.666986:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448476.667162:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448476.667309:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789448476.667319:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789448476.668354:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789448476.668361:0:15816:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789448476.668366:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448476.668368:0:15816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789448476.668371:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448476.668391:0:15816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97d8c2c199c0) 00000020:00000080:3.0:1789448476.668410:0:15816:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789448476.668414:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448476.668461:0:15816:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97da01b5c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789448476.668466:0:15816:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789448476.668470:0:15816:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe29566c2465fa9fc 00010000:00010000:2.0:1789448476.672026:0:15816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789448476.672476:0:15816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789448476.673912:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789448476.679547:0:15816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789448476.679560:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.679567:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.679569:0:15816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789448476.679574:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448476.679579:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.679580:0:15816:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789448476.679583:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789448476.679585:0:15816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789448476.679588:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.679590:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.679591:0:15816:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789448476.679593:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448476.679595:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.679596:0:15816:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789448476.679600:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789448476.679668:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.679671:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.679673:0:15816:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789448476.679676:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789448476.680755:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789448476.680786:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789448476.680826:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa9ee expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.680839:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33200/0xe29566c2465fa9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fa9ee expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448476.680847:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97da01b5c000 from 1 10000000:01000000:0.0:1789448476.680850:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448476.680888:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.680896:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.680909:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448476.680936:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448476.681007:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448476.681035:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374464 00000100:00100000:2.0:1789448476.681044:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374464 00000100:00100000:0.0:1789448476.681044:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.681092:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789448476.681108:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:15814:x1876372317374464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448476.681122:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448476.681134:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465faa03 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.681158:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.681168:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.681176:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130b600, rc 0) 00000100:00100000:2.0:1789448476.682093:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374464:12345-0@lo:101:mount.lustre.0 Request processed in 983us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.682103:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789448476.682474:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448476.682495:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.682515:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448476.682997:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789448476.683906:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448476.684409:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789448476.684453:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789448476.684528:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789448476.684537:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789448476.684614:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.684679:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.684723:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448476.686263:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374592 00000100:00100000:3.0:1789448476.686274:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374592 00000100:00100000:3.0:1789448476.686327:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789448476.686337:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448476.687009:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374592:12345-0@lo:501:mount.lustre.0 Request processed in 671us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448476.687019:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789448476.687090:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.687135:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448476.687181:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.687399:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448476.688467:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374720 00000100:00100000:0.0:1789448476.688477:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374720 00000100:00100000:0.0:1789448476.688531:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789448476.688540:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448476.688906:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374720:12345-0@lo:503:mount.lustre.0 Request processed in 367us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448476.688914:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789448476.688973:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789448476.689490:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448476.689573:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448476.689614:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.689658:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.689691:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374848 00000100:00100000:2.0:1789448476.689696:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374848 00000100:00100000:2.0:1789448476.689729:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789448476.689736:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448476.689901:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374848:12345-0@lo:502:mount.lustre.0 Request processed in 165us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.689908:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789448476.689958:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448476.690187:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789448476.690252:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789448476.690297:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789448476.690319:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789448476.690334:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789448476.690368:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789448476.690385:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789448476.690401:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789448476.690416:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448476.690445:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448476.690469:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e7acc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448476.690561:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317374976 00000100:00100000:1.0:1789448476.690566:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317374976 00000100:00100000:1.0:1789448476.690596:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448476.690603:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448476.690989:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317374976:12345-0@lo:502:mount.lustre.0 Request processed in 386us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448476.690997:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789448476.691008:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317374976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448476.691167:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789448476.691176:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789448476.692026:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448476.692035:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692037:0:15820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789448476.692043:0:15820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97da01b5c000 00000020:00000080:2.0:1789448476.692045:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789448476.692050:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.692052:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692053:0:15820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789448476.692054:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448476.692056:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692056:0:15820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789448476.692058:0:15820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97da01b5c000 00000020:00000080:2.0:1789448476.692060:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789448476.692104:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.692107:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692109:0:15820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789448476.692111:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448476.692113:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692114:0:15820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789448476.692118:0:15820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97da01b5c000 00000020:00000080:2.0:1789448476.692120:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789448476.692150:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448476.692152:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448476.692160:0:15820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789448476.692163:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789448476.692343:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789448476.692366:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448476.692383:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.692395:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448476.692436:0:15814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789448476.692439:0:15814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97da01b5c000 10000000:01000000:0.0:1789448476.692442:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97da01b5c000 10000000:01000000:0.0:1789448476.692446:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448476.692451:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97da01b5c000 from 1 10000000:01000000:0.0:1789448476.692454:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789448476.692483:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.692491:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448476.692512:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448476.692531:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448476.692583:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.692660:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.692694:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375104 00000100:00100000:2.0:1789448476.692701:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375104 00000100:00100000:2.0:1789448476.692768:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789448476.692778:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317375104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448476.692791:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448476.692805:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c130a800/0xe29566c2465faa18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465faa11 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.692829:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c130a800/0xe29566c2465faa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465faa11 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.692839:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c130a800/0xe29566c2465faa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465faa11 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.692847:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130a800, rc 0) 00000100:00100000:2.0:1789448476.692890:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375104:12345-0@lo:101:mount.lustre.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.692897:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448476.692964:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448476.692978:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa18 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.692984:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465faa18 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448476.693434:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789448476.693691:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448476.694102:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789448476.694143:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789448476.694172:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789448476.694234:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789448476.694272:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789448476.694321:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789448476.694356:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789448476.694388:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789448476.694444:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789448476.694557:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789448476.694594:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789448476.694640:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789448476.694687:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789448476.694902:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789448476.694957:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789448476.694992:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789448476.695024:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789448476.695069:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789448476.695103:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789448476.695136:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789448476.695182:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789448476.695241:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789448476.695275:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789448476.695320:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789448476.695353:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789448476.695386:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789448476.695430:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789448476.695465:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789448476.695604:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789448476.695655:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789448476.695690:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789448476.695801:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789448476.695838:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789448476.695956:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789448476.695991:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789448476.696036:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789448476.696070:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789448476.696154:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789448476.696161:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789448476.696275:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.696343:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.696391:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448476.696673:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375232 00000100:00100000:0.0:1789448476.696681:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375232 00000100:00100000:0.0:1789448476.696725:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789448476.696734:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448476.696962:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375232:12345-0@lo:501:mount.lustre.0 Request processed in 228us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448476.696978:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448476.697009:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448476.697043:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448476.697078:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.697148:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c331b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448476.697414:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375360 00000100:00100000:0.0:1789448476.697420:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375360 00000100:00100000:0.0:1789448476.697491:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448476.697498:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f56be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448476.697799:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f56be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375360:12345-0@lo:503:mount.lustre.0 Request processed in 301us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448476.697806:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448476.698094:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789448476.698718:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448476.698852:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448476.698984:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.699063:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448476.699100:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375488 00000100:00100000:1.0:1789448476.699106:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375488 00000100:00100000:1.0:1789448476.699176:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789448476.699186:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448476.699494:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375488:12345-0@lo:502:mount.lustre.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448476.699510:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789448476.699649:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448476.700018:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789448476.700066:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789448476.700101:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789448476.700150:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789448476.700185:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789448476.700251:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789448476.700287:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789448476.700334:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789448476.700380:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789448476.700412:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789448476.700442:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789448476.700790:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789448476.700832:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789448476.700956:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789448476.701008:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789448476.701043:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789448476.701077:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789448476.701123:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789448476.701157:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789448476.701189:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789448476.701262:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789448476.701296:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789448476.701329:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789448476.701392:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789448476.701442:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789448476.701665:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789448476.701805:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789448476.701848:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789448476.701965:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789448476.702015:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789448476.702048:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789448476.702078:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789448476.702110:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789448476.702151:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789448476.702182:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789448476.702397:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789448476.702436:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789448476.702468:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789448476.703041:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789448476.703597:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789448476.703646:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448476.703845:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.704235:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafe6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448476.704343:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375616 00000100:00100000:3.0:1789448476.704351:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375616 00000100:00100000:3.0:1789448476.704395:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789448476.704404:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448476.704639:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317375616:12345-0@lo:502:mount.lustre.0 Request processed in 235us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448476.704651:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789448476.705208:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317375616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448476.706859:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789448476.706877:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789448476.712778:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789448476.712793:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97d9eada8000) 00000020:00000080:1.0:1789448476.712813:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789448476.712894:0:15825:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97da01b5c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448476.712898:0:15825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97da01b5c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448476.712900:0:15825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97da01b5c000 3 00010000:00080000:1.0:1789448476.712924:0:15825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97d9c336b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1789448476.714288:0:15825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789448476.714465:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789448476.714496:0:15825:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789448476.714517:0:15825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe29566c2465faa26 00000100:00080000:1.0:1789448476.714526:0:15825:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789448476.714535:0:15825:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97d9c336b000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448476.714569:0:15825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fd9500 x1876372317375744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448476.714603:0:15825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789448476.715545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448476.715551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789448476.715554:0:37:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448476.715559:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1789448476.715563:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789448476.715571:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9d2e64000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448476.715588:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fd8700 x1876372317376000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448476.715639:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317376256:0@lo:400:kworker.0 00000100:00100000:1.0:1789448476.715702:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448476.715794:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376256 00000100:00100000:3.0:1789448476.715801:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376256 00000100:00100000:3.0:1789448476.715849:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448476.715858:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317376256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448476.715908:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317376256:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448476.715916:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789448476.715934:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789448476.715962:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fdaa00 x1876372317376256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448476.715974:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317376256:0@lo:400:kworker.0 00000040:00080000:1.0:1789448476.716137:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789448476.717290:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317375744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789448476.717343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.717378:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317376000:0@lo:8:kworker.0 00000100:00100000:0.0:1789448476.717399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448476.717433:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375744 00000100:00100000:0.0:1789448476.717438:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375744 00000100:00100000:0.0:1789448476.717468:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448476.717474:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876372317375744:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789448476.717497:0:14402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1789448476.717546:0:14402:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe29566c2465faa2d 00000004:00100000:0.0:1789448476.717558:0:14402:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789448476.717585:0:14402:0:(import.c:65:import_set_state_nolock()) ffff97d8c11ac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448476.717626:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876372317375744:12345-0@lo:38:llog_process_th.0 Request processed in 151us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448476.717633:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789448476.717658:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fd9500 x1876372317375744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448476.717668:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789448476.717675:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789448476.717682:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789448476.717687:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789448476.717689:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9c336b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789448476.717694:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876372317375744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789448476.717936:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376000 00000100:00100000:3.0:1789448476.717941:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376000 00000100:00100000:3.0:1789448476.717972:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448476.717977:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317376000:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789448476.718020:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876372317376000:12345-0@lo:8:kworker.0 Request processed in 42us (619us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789448476.718026:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789448476.718042:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789448476.718046:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000020:01000000:3.0:1789448476.718047:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00080000:1.0:1789448476.718050:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789448476.718052:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317376000:0@lo:8:kworker.0 10000000:01000000:3.0:1789448476.718077:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789448476.718092:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa18 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448476.718103:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fae32c00/0xe29566c2465faa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa18 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789448476.718151:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789448476.718153:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789448476.718154:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448476.718155:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448476.718156:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448476.718157:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448476.718158:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789448476.718159:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448476.718160:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448476.718163:0:15814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789448476.718165:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789448476.718165:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789448476.718166:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448476.718167:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448476.718167:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448476.718168:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448476.718168:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789448476.718169:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448476.718170:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448476.718183:0:15814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789448476.718192:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317376384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789448476.718248:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448476.718272:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376384 00000100:00100000:3.0:1789448476.718276:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376384 00000100:00100000:3.0:1789448476.718299:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789448476.718304:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:15814:x1876372317376384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789448476.718321:0:14397:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789448476.718333:0:14397:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789448476.718681:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d8c39ba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.718865:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317375872:0@lo:400:kworker.0 00000100:00100000:2.0:1789448476.718900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448476.718932:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448476.718939:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317376128:0@lo:400:kworker.0 00000100:00100000:1.0:1789448476.718955:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317375872 00000100:00100000:1.0:1789448476.718960:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317375872 00000100:00100000:2.0:1789448476.718962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.718993:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448476.718998:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876372317375872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448476.719048:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876372317375872:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448476.719054:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448476.719067:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317375872:0@lo:400:kworker.0 00000100:00100000:3.0:1789448476.721143:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376128 00000100:00100000:3.0:1789448476.721154:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376128 00000100:00100000:3.0:1789448476.721203:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448476.721212:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317376128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448476.721315:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317376128:12345-0@lo:400:kworker.0 Request processed in 104us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448476.721323:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789448476.721343:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789448476.721382:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97d9c7fda680 x1876372317376128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448476.721396:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317376128:0@lo:400:kworker.0 20000000:01000000:2.0:1789448476.782891:0:14397:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789448476.782911:0:14397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789448476.782980:0:14418:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789448476.782985:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789448476.783008:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.783028:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa900 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.783037:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.783080:0:14418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448476.783097:0:14418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 19 pid: 14395 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448476.783112:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317376512:0@lo:104: 00000100:00100000:1.0:1789448476.783185:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448476.783261:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c1254f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448476.783333:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376512 00000100:00100000:2.0:1789448476.783340:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376512 00000100:00100000:2.0:1789448476.783391:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448476.783401:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317376512:12345-0@lo:104: 00010000:00010000:2.0:1789448476.783424:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783480:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789448476.783486:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:14418:x1876372317376512:12345-0@lo:104: Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.783493:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448476.783734:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14418:1876372317376512:0@lo:104: 00010000:00010000:2.0:1789448476.783754:0:14418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783772:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448476.783778:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783784:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34200 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448476.783788:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783797:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448476.783804:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448476.783837:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448476.783874:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783880:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448476.783902:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783909:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9d2a34200/0xe29566c2465fa900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa907 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.783926:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448476.783927:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448476.783929:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448476.783942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317376640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448476.783972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448476.784008:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376640 00000100:00100000:2.0:1789448476.784013:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376640 00010000:00010000:2.0:1789448476.784031:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 20 pid: 14395 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448476.784050:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448476.784056:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+20:3305:x1876372317376640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448476.784066:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448476.784071:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 20 pid: 14395 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784081:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 20 pid: 14395 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784099:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fa907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa900 expref: 20 pid: 14395 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784111:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784119:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789448476.784131:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001584308s 00010000:00010000:2.0:1789448476.784136:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784143:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784150:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784156:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784162:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448476.784166:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784173:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784187:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784202:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448476.784268:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+19:3305:x1876372317376640:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.784275:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789448476.784305:0:14418:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784313:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448476.784319:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9d2a35400/0xe29566c2465faa34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448476.784350:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317376640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448476.797402:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:15814:x1876372317376384:12345-0@lo:253:mount.lustre.0 Request processed in 79088us (79144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448476.797428:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789448476.797651:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67d9a8de-e7f1-4030-af60-fc835c982539:15814:1876372317376384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789448476.797669:0:15814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789448476.797672:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448476.797674:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789448476.797675:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448476.797677:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448476.797678:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448476.797679:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448476.797681:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448476.797683:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448476.797684:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789448476.797700:0:15814:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789448476.803871:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448476.804078:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789448476.804274:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448476.804656:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789448476.804806:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789448476.805021:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789448476.806176:0:15814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1789448476.831798:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789448476.869031:0:15814:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789448476.869040:0:15814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789448476.869076:0:15814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789448476.869141:0:15814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789448476.869154:0:15814:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789448476.869183:0:15814:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789448477.854229:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789448477.913512:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789448477.913522:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97d9d0ac8800 from 8 10000000:01000000:1.0:1789448477.913528:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789448477.913587:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448477.913600:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448477.913612:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448477.913639:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317376768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448477.913711:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448477.913772:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c54549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448477.913865:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376768 00000100:00100000:0.0:1789448477.913873:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376768 00000100:00100000:0.0:1789448477.913933:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789448477.913943:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d0ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317376768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448477.913955:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448477.913978:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32800/0xe29566c2465faa42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465faa3b expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448477.914011:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32800/0xe29566c2465faa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465faa3b expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448477.914023:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32800/0xe29566c2465faa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465faa3b expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448477.914031:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32800, rc 0) 00000100:00100000:0.0:1789448477.914242:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d0ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317376768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448477.914249:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448477.914707:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317376768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448477.914725:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa42 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448477.914735:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465faa42 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448477.914789:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317376896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789448477.914832:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448477.914854:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c6088300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448477.916252:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317376896 00000100:00100000:0.0:1789448477.916265:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317376896 00000100:00100000:0.0:1789448477.916316:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789448477.916325:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317376896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789448477.916356:0:14397:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789448477.916373:0:14397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789448477.916376:0:14397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789448477.916510:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317376896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448477.916520:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448477.916545:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317376896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789448477.918181:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448477.918196:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa42 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448477.918211:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35c00/0xe29566c2465faa3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faa42 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448478.050644:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789448478.050699:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789448478.874928:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448479.003926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317377024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448479.003999:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448479.004075:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377024 00000100:00100000:3.0:1789448479.004083:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377024 00000100:00100000:3.0:1789448479.004134:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448479.004142:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317377024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448479.004176:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448479.004233:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317377024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448479.004240:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789448479.004260:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448479.004286:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789448479.004305:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317377024:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789448479.323990:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448479.904036:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448480.921654:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448481.945346:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448482.073927:0:13978:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448482.073934:0:13978:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789448482.073937:0:13978:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448482.073957:0:13978:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97d9d2e64000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789448482.073978:0:13978:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97d9c7fdbb80 x1876372317377408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448482.074145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317377152:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.074384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.074439:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317377792:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.074478:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.074519:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448482.074525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317377664:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.074913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.075143:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317377280:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.075180:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.075207:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448482.075212:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317377536:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.075257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448482.075303:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377280 00000100:00100000:3.0:1789448482.075312:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377280 00000100:00100000:3.0:1789448482.075364:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448482.075374:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317377280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448482.075434:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317377280:12345-0@lo:400:kworker.0 Request processed in 61us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448482.075442:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789448482.075483:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448482.077273:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317377408:0@lo:8:kworker.0 00000100:00100000:3.0:1789448482.077328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.080784:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317377280:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.080826:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377152 00000100:00100000:1.0:1789448482.080833:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377152 00000100:00100000:1.0:1789448482.080882:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448482.080891:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:3307:x1876372317377152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.080956:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:3307:x1876372317377152:12345-0@lo:400:kworker.0 Request processed in 65us (6740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448482.080963:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789448482.080998:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377408 00000100:00100000:1.0:1789448482.081002:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377408 00000100:00100000:1.0:1789448482.081020:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448482.081025:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1876372317377408:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789448482.081049:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:1.0:1789448482.081079:0:15088:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe29566c2465faa49 00002000:00100000:1.0:1789448482.081092:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97d9c3369000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789448482.081096:0:15088:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789448482.081099:0:15088:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789448482.081448:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448482.081672:0:15088:0:(import.c:65:import_set_state_nolock()) ffff97d9c336a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448482.081723:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876372317377408:12345-0@lo:8:kworker.0 Request processed in 696us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448482.081730:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448482.082630:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377792 00000100:00100000:2.0:1789448482.082640:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377792 00000100:00100000:2.0:1789448482.082691:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377664 00000100:00100000:2.0:1789448482.082695:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377664 00000100:00100000:2.0:1789448482.082709:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377536 00000100:00100000:2.0:1789448482.082712:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377536 00000100:00100000:2.0:1789448482.082730:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789448482.082737:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317377792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448482.082786:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317377792:12345-0@lo:400:kworker.0 Request processed in 49us (8307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448482.082792:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789448482.082806:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789448482.082818:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317377664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448482.082844:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876372317377664:12345-0@lo:400:kworker.0 Request processed in 27us (7932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448482.082850:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789448482.082861:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448482.082866:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317377536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448482.082895:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317377536:12345-0@lo:400:kworker.0 Request processed in 28us (7636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448482.082900:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789448482.082917:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789448482.087095:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9c7fd9c00 x1876372317377664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448482.087114:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876372317377664:0@lo:400:kworker.0 00000100:00100000:1.0:1789448482.087126:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317377152:0@lo:400:kworker.0 00010000:00080000:1.0:1789448482.087137:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9c7fd8700 x1876372317377792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448482.087145:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317377792:0@lo:400:kworker.0 00010000:00080000:1.0:1789448482.087192:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9c7fdbb80 x1876372317377408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789448482.087204:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789448482.087212:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789448482.087234:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789448482.087237:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97d9d2e64000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789448482.087249:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789448482.087254:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876372317377408:0@lo:8:kworker.0 00010000:00080000:1.0:1789448482.087280:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9c7fd8000 x1876372317377536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448482.087289:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317377536:0@lo:400:kworker.0 00000004:00080000:1.0:1789448482.088791:0:14427:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789448482.088817:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14427:1876372317378048:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789448482.088881:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.088912:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d1997480 going to sleep for 11 seconds 00000100:00100000:1.0:1789448482.088932:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448482.088962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448482.088998:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378048 00000100:00100000:1.0:1789448482.089006:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378048 00000100:00100000:1.0:1789448482.089057:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448482.089067:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14427:x1876372317378048:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789448482.094653:0:14426:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789448482.095029:0:14426:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 503797810600ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789448482.096676:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317377920 00000100:00100000:0.0:1789448482.096690:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317377920 00000100:00100000:0.0:1789448482.096740:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448482.096751:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876372317377920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448482.096785:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448482.096869:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876372317377920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (7905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448482.096877:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789448482.097189:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97d9c7fd8000 x1876372317377920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448482.097210:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317377920:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789448482.098863:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789448482.099012:0:15086:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789448482.099021:0:15086:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789448482.099027:0:15086:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789448482.119602:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.119614:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119643:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.119648:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.119654:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119673:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119684:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119693:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119711:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.119724:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.119729:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119737:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.119742:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119752:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119781:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119789:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f26e2c9e/0xe29566c2465faa50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.119805:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.119807:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.119809:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.120392:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.120400:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120408:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.120412:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.120416:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120425:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120433:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120440:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120479:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.120489:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.120493:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120500:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.120503:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120511:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120522:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120529:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465faa57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120541:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.120543:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.120544:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.120934:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.120941:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120950:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.120958:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.120963:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120973:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120980:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.120986:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121000:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.121009:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.121013:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121020:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.121023:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121031:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121041:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121058:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faa5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121071:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.121072:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.121074:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.121509:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.121515:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121523:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.121526:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.121530:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121539:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121547:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121554:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121569:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.121577:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.121586:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121592:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.121595:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121603:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121613:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121621:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faa65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.121633:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.121635:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.121637:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.122028:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.122034:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122043:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.122046:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.122051:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122071:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122079:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122086:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122099:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.122107:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.122111:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122117:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.122120:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122127:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122137:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122144:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faa6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.122165:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.122167:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.122169:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.128188:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.128204:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128239:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.128244:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.128251:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128266:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128277:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128285:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128301:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.128901:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.128908:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128930:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.128934:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.128938:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128948:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128957:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128964:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.128982:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789448482.128995:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448482.129001:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129009:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.129014:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129024:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129052:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129059:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faa73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129080:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.129083:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129091:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.129094:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129101:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129110:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129117:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faa7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.129128:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.129130:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.129137:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.129582:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.132305:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.132321:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132337:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.132342:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.132348:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132361:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132371:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132378:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132394:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.132884:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.132890:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132898:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.132902:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.132906:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132926:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132934:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132940:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132956:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789448482.132971:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448482.132977:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132985:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.132990:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.132998:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133013:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133021:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faa81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133047:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.133051:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133057:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.133060:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133067:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133077:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133084:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faa88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133096:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.133098:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.133100:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.133507:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.133797:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.133804:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133815:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.133824:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.133830:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133840:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133849:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133856:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.133881:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448482.134930:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448482.134941:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.134951:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.134956:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.134965:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.134988:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.134995:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9f5ca73/0xe29566c2465faa8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.135031:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.135034:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.135036:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.136602:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.136614:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.136630:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.136633:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.136640:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.136653:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.136664:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.136680:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.136738:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.137308:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.137315:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.137324:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.137328:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.137333:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.137343:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.137351:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.137358:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143123:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448482.143139:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143154:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.143159:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143171:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143192:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143199:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faa96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143240:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448482.143244:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143250:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031800 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.143261:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143269:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143280:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.143288:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.143290:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.143292:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.143403:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789448482.143411:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280b9b69/0xe29566c2465faa9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448482.144092:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.144099:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144110:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.144114:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.144120:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144132:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144140:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144147:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144161:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.144629:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.144636:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144644:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.144648:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.144659:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144669:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144677:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144684:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.144693:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789448482.145078:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.145085:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145094:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.145096:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.145100:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145109:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145117:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145135:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145144:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789448482.145630:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.145636:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145645:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.145648:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.145653:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145662:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145670:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145676:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.145685:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789448482.146099:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.146105:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.146119:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.146123:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.146126:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.146136:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.146144:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.146152:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.146160:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789448482.146763:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789448482.146771:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146780:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0030200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.146784:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146793:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146810:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146816:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036fe4da0/0xe29566c2465faaa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146843:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789448482.146848:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146854:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0030a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.146857:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146864:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146873:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146880:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ad6d631/0xe29566c2465faaab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146891:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448482.146894:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146900:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.146903:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146922:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146932:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146939:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb96fc92/0xe29566c2465faab2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146952:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448482.146955:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146961:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.146964:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146970:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146979:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.146987:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbef5724/0xe29566c2465faab9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147010:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448482.147015:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147021:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0030600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.147023:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147031:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147041:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147047:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d232998/0xe29566c2465faac0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.147058:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.147059:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.147061:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.147069:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.157834:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.157851:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.157868:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.157873:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.157881:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.157896:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.157920:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.157928:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.157957:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448482.159126:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448482.159137:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.159147:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c0031400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448482.159160:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.159170:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.159190:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.159197:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb970db/0xe29566c2465faac7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448482.159233:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.159235:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448482.159237:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789448482.159681:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789448482.159865:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.159873:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.159884:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.159889:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.159894:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.159905:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.159914:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.159922:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.160273:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.160878:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.160885:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.160896:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.160900:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.160904:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.160915:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.160924:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.160932:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163695:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448482.163712:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163726:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.163732:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163744:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163780:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163788:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356e73c7/0xe29566c2465faace lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163821:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448482.163825:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163852:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32e00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.163856:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163864:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163876:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.163884:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.163886:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.163887:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.166746:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789448482.166761:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7818609/0xe29566c2465faad5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448482.167527:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.167537:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.167557:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.167562:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.167569:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.167584:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.167595:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.167602:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.168510:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448482.168522:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.168533:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.168537:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.168546:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.168564:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.168583:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.168585:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.168587:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.171207:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789448482.171241:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4ba192/0xe29566c2465faadc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.172603:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.173207:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.173250:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.173270:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.173276:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.173283:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.173315:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.173326:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.173334:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.173355:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448482.173776:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448482.173784:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.173792:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33c00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.173798:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.173806:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.173824:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.173830:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000917f1325/0xe29566c2465faae3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.173850:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.173851:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.173853:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448482.175159:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789448482.175169:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448482.175183:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1789448482.175187:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448482.175193:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448482.175208:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448482.175247:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448482.175255:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448482.175286:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448482.176724:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448482.176736:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.176756:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.176761:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.176772:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.176791:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.176799:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067852a2b/0xe29566c2465faaea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.176823:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.176825:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.176826:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.178012:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.178022:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178037:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.178042:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.178048:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178062:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178072:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178090:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178113:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448482.178663:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.178669:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178677:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.178680:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.178684:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178693:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178702:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178710:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178729:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789448482.178741:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448482.178746:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178760:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.178765:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178774:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178791:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178799:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4359b6a/0xe29566c2465faaf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178816:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.178819:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178825:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33a00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.178829:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178836:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178846:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178861:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1fe315b/0xe29566c2465faaf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.178876:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.178878:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.178880:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.179340:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.179346:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179355:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.179359:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.179363:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179373:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179381:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179389:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179405:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448482.179414:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448482.179424:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179430:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448482.179434:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179442:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179462:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.179470:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6ea4b4/0xe29566c2465faaff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.179599:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.181751:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.181755:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448482.181757:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448482.182487:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789448482.182499:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.182518:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789448482.182524:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448482.182531:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.182559:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.182571:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.182580:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448482.182610:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789448482.182800:0:15086:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1789448482.182895:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14427:x1876372317378048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93826us (94010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448482.182905:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448482.182965:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14427:1876372317378048:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789448482.182979:0:14427:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789448482.183023:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14427:1876372317378176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789448482.183056:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448482.183097:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448482.183114:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378176 00000100:00100000:0.0:1789448482.183120:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378176 00000100:00100000:0.0:1789448482.183161:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448482.183169:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14427:x1876372317378176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789448482.183203:0:15087:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789448482.185588:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448482.185602:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.185617:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32400 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448482.185622:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.185633:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.185664:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.185671:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000164ca360/0xe29566c2465fab06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448482.185696:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.185698:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448482.185700:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448482.188907:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14427:x1876372317378176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5731us (5842us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789448482.188919:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448482.189176:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14427:1876372317378176:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789448482.189191:0:14427:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789448482.969475:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789448483.529427:0:16173:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789448483.993646:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448484.121543:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317378304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448484.121619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448484.121782:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378304 00000100:00100000:3.0:1789448484.121791:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378304 00000100:00100000:3.0:1789448484.121856:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448484.121865:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317378304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448484.121914:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789448484.123772:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448484.124777:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317378304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2906us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448484.124789:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448484.128684:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317378304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789448485.018466:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448485.763878:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.763994:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295359744 00000100:00100000:1.0:1789448485.764005:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295359744 00000100:00100000:1.0:1789448485.764058:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1789448485.764066:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1876372295359744:12345-192.168.202.54@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789448485.764096:0:14396:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 62408e71-32ad-4b6c-9be5-c8230c7ca7d3@192.168.202.54@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1789448485.764127:0:14396:0:(genops.c:1384:class_connect()) connect: client 62408e71-32ad-4b6c-9be5-c8230c7ca7d3, cookie 0xe29566c2465fab0d 00000100:00080000:1.0:1789448485.764303:0:14396:0:(import.c:65:import_set_state_nolock()) ffff97d9c336c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448485.764364:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+5:2347:x1876372295359744:12345-192.168.202.54@tcp:250:mount.lustre.0 Request processed in 297us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.764372:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1789448485.771268:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.771387:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295359872 00000100:00100000:1.0:1789448485.771398:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295359872 00000100:00100000:1.0:1789448485.771466:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:1.0:1789448485.771476:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+5:13761:x1876372295359872:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789448485.771493:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448485.771524:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a35600/0xe29566c2465fab14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f04a expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.771552:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a35600/0xe29566c2465fab14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f04a expref: 6 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.771564:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a35600/0xe29566c2465fab14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f04a expref: 6 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.771574:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35600, rc 0) 00000100:00100000:1.0:1789448485.771635:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+6:13761:x1876372295359872:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 160us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.771651:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:0.0:1789448485.776526:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448485.776670:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360000 00000100:00100000:2.0:1789448485.776681:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360000 00000100:00100000:2.0:1789448485.776745:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789448485.776757:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+6:13761:x1876372295360000:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448485.777062:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+6:13761:x1876372295360000:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 307us (545us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789448485.777070:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789448485.788327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448485.792701:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360128 00000100:00100000:0.0:1789448485.792716:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360128 00000100:00100000:0.0:1789448485.792823:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:0.0:1789448485.792835:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+6:13761:x1876372295360128:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448485.792852:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448485.792871:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33400/0xe29566c2465fab1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f051 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.792900:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33400/0xe29566c2465fab1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f051 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.792911:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33400/0xe29566c2465fab1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f051 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.792921:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33400, rc 0) 00000100:00100000:0.0:1789448485.792984:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+7:13761:x1876372295360128:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 152us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448485.792992:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:3.0:1789448485.805683:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.805800:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360256 00000100:00100000:1.0:1789448485.805810:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360256 00000100:00100000:1.0:1789448485.805869:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:1.0:1789448485.805880:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+7:13761:x1876372295360256:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789448485.806171:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13761:x1876372295360256:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 291us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.806180:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1789448485.808849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448485.809477:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360384 00000100:00100000:0.0:1789448485.809487:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360384 00000100:00100000:0.0:1789448485.809544:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:0.0:1789448485.809553:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13761:x1876372295360384:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789448485.809833:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13761:x1876372295360384:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 280us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448485.809841:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1789448485.819362:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448485.825611:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360512 00000100:00100000:2.0:1789448485.825628:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360512 00000100:00100000:3.0:1789448485.833430:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1789448485.833446:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13779:x1876372295360512:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789448485.833748:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13779:x1876372295360512:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 305us (14395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448485.833763:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1789448485.854576:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.854669:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360640 00000100:00100000:1.0:1789448485.854682:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360640 00000100:00100000:1.0:1789448485.854743:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:1.0:1789448485.854753:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13779:x1876372295360640:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448485.855042:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13779:x1876372295360640:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 290us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.855051:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:1.0:1789448485.864659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448485.864768:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360768 00000100:00100000:0.0:1789448485.864779:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360768 00000100:00100000:0.0:1789448485.864838:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:0.0:1789448485.864849:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+8:13761:x1876372295360768:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448485.864864:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448485.864883:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fab22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f07b expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.864913:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fab22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f07b expref: 9 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.864926:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32e00/0xe29566c2465fab22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f07b expref: 9 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448485.864936:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32e00, rc 0) 00000100:00100000:0.0:1789448485.865004:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+9:13761:x1876372295360768:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448485.865011:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789448485.877291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448485.877463:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295360896 00000100:00100000:3.0:1789448485.877474:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295360896 00000100:00100000:3.0:1789448485.877533:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:3.0:1789448485.877544:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+9:13761:x1876372295360896:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789448485.877580:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789448485.877600:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789448485.877604:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789448485.877607:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789448485.877610:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789448485.880461:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+9:13761:x1876372295360896:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 2910us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.880475:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1789448485.886681:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.893783:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361024 00000100:00100000:1.0:1789448485.893800:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361024 00000100:00100000:1.0:1789448485.893912:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1789448485.893923:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+9:13761:x1876372295361024:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789448485.893939:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448485.893958:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f082 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.893988:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.894000:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448485.894009:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35000, rc 0) 00000100:00100000:1.0:1789448485.894087:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13761:x1876372295361024:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 166us (7416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.894095:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1789448485.901959:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448485.908237:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361152 00000100:00100000:0.0:1789448485.908255:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361152 00000100:00100000:3.0:1789448485.908962:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1789448485.908979:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e79e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13761:x1876372295361152:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789448485.911006:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e79e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13761:x1876372295361152:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 1469us (8493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448485.911019:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1789448485.913755:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.914111:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361280 00000100:00100000:1.0:1789448485.914121:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361280 00000100:00100000:1.0:1789448485.914191:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:1.0:1789448485.914202:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13761:x1876372295361280:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789448485.914720:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13761:x1876372295361280:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 519us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.914734:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1789448485.923257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.923452:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361408 00000100:00100000:1.0:1789448485.923463:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361408 00000100:00100000:1.0:1789448485.923510:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:1.0:1789448485.923520:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13783:x1876372295361408:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448485.923809:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13783:x1876372295361408:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 289us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.923818:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:3.0:1789448485.929084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448485.929784:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361536 00000100:00100000:1.0:1789448485.929802:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361536 00000100:00100000:1.0:1789448485.929880:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:1.0:1789448485.929892:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13783:x1876372295361536:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448485.930181:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13783:x1876372295361536:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 290us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448485.930190:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1789448485.940113:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448485.940394:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361664 00000100:00100000:2.0:1789448485.940410:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361664 00000100:00100000:2.0:1789448485.940471:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:2.0:1789448485.940481:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1876372295361664:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789448485.940510:0:14404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4db323be-9e14-4d2f-b81e-5e0bd7b89701@192.168.202.54@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1789448485.940688:0:14404:0:(genops.c:1384:class_connect()) connect: client 4db323be-9e14-4d2f-b81e-5e0bd7b89701, cookie 0xe29566c2465fab30 00000004:00100000:2.0:1789448485.940720:0:14404:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1789448485.940726:0:14404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789448486.037165:0:14404:0:(import.c:65:import_set_state_nolock()) ffff97d8c2238000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448486.037274:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2347:x1876372295361664:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 96791us (97183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448486.037287:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00010000:00010000:3.0:1789448486.041645:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448486.043053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448486.043094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448486.044701:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361920 00000100:00100000:2.0:1789448486.044716:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361920 00000100:00100000:2.0:1789448486.044899:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295361792 00000100:00100000:2.0:1789448486.044903:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295361792 00000100:00100000:2.0:1789448486.044924:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448486.044933:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:13761:x1876372295361920:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789448486.044981:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789448486.045081:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:13761:x1876372295361920:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 148us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448486.045088:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448486.045108:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448486.045115:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:0:x1876372295361792:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789448486.045141:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789448486.045165:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:0:x1876372295361792:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 50us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448486.045171:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789448486.047923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448486.048180:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362048 00000100:00100000:2.0:1789448486.048191:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362048 00000100:00100000:2.0:1789448486.048283:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789448486.048295:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:13761:x1876372295362048:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789448486.048378:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:13761:x1876372295362048:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 85us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448486.048386:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00080000:0.0:1789448486.049802:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448486.051963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448486.052049:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448486.052085:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448486.052282:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362432 00000100:00100000:0.0:1789448486.052293:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362432 00000100:00100000:0.0:1789448486.052336:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789448486.052346:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:13761:x1876372295362432:12345-192.168.202.54@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789448486.052497:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362176 00000100:00100000:1.0:1789448486.052502:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362176 00000100:00100000:1.0:1789448486.052529:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362304 00000100:00100000:1.0:1789448486.052532:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362304 00000100:00100000:1.0:1789448486.052545:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448486.052551:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295362176:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789448486.052582:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4db323be-9e14-4d2f-b81e-5e0bd7b89701@192.168.202.54@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1789448486.052616:0:15088:0:(genops.c:1384:class_connect()) connect: client 4db323be-9e14-4d2f-b81e-5e0bd7b89701, cookie 0xe29566c2465fab37 00002000:00100000:1.0:1789448486.052627:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4db323be-9e14-4d2f-b81e-5e0bd7b89701/ffff97d9c3368000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448486.052656:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789448486.052998:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789448486.053028:0:15088:0:(import.c:65:import_set_state_nolock()) ffff97d9c336f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448486.053091:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2347:x1876372295362176:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 538us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448486.053099:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448486.053119:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448486.053124:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295362304:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789448486.053140:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4db323be-9e14-4d2f-b81e-5e0bd7b89701@192.168.202.54@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1789448486.053156:0:15088:0:(genops.c:1384:class_connect()) connect: client 4db323be-9e14-4d2f-b81e-5e0bd7b89701, cookie 0xe29566c2465fab3e 00002000:00100000:1.0:1789448486.053162:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4db323be-9e14-4d2f-b81e-5e0bd7b89701/ffff97d9c336f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448486.053177:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789448486.053316:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448486.053332:0:15088:0:(import.c:65:import_set_state_nolock()) ffff97d9c336d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448486.053355:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2347:x1876372295362304:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 230us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448486.053362:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000004:00080000:1.0:1789448486.053920:0:14405:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1496us 00000004:00200000:0.0:1789448486.083969:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789448486.084098:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:13761:x1876372295362432:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 31745us (32137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448486.084109:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789448486.264497:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448486.264819:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362560 00000100:00100000:1.0:1789448486.264830:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362560 00000100:00100000:1.0:1789448486.265016:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448486.265029:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:13804:x1876372295362560:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:1.0:1789448486.265052:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448486.265080:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fab45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f0ac expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265188:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265203:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265260:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448486.265301:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789448486.265305:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448486.265343:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265372:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fab45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0ac expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265391:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0ac expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448486.265400:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:1.0:1789448486.265403:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448486.265407:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448486.265630:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:13804:x1876372295362560:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 603us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448486.265638:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:0.0:1789448487.065680:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448487.193494:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448487.193519:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317378432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448487.193594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448487.193658:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317378560:0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.193665:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317378688:0@lo:400:kworker.0 00000100:00100000:2.0:1789448487.193751:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317378944:0@lo:400:kworker.0 00000100:00100000:1.0:1789448487.193757:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317378816:0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.207177:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448487.207274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448487.207320:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317379072:0@lo:400:kworker.0 00000100:00100000:0.0:1789448487.207361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448487.207413:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378560 00000100:00100000:0.0:1789448487.207421:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378560 00000100:00100000:0.0:1789448487.207470:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789448487.207481:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:3307:x1876372317378560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448487.207541:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:3307:x1876372317378560:12345-0@lo:400:kworker.0 Request processed in 63us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448487.207550:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789448487.207607:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317378560:0@lo:400:kworker.0 00000100:00100000:0.0:1789448487.207654:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378688 00000100:00100000:0.0:1789448487.207658:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378688 00000100:00100000:0.0:1789448487.207717:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448487.207724:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317378688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.207764:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379072 00000100:00100000:3.0:1789448487.207769:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379072 00000100:00100000:0.0:1789448487.207771:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317378688:12345-0@lo:400:kworker.0 Request processed in 47us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448487.207791:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448487.207806:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448487.207814:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317379072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.207857:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876372317379072:12345-0@lo:400:kworker.0 Request processed in 44us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448487.207864:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448487.207890:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317378688:0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.207913:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876372317379072:0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.207944:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378432 00000100:00100000:3.0:1789448487.207948:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378432 00000100:00100000:3.0:1789448487.207970:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448487.207976:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317378432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448487.207990:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789448487.208015:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448487.208021:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448487.208024:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448487.208032:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876372317378432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (14436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448487.208039:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448487.208072:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317378432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448487.208325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448487.208538:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378944 00000100:00100000:3.0:1789448487.208543:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378944 00000100:00100000:3.0:1789448487.208586:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448487.208593:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317378944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448487.208645:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876372317378944:12345-0@lo:400:kworker.0 Request processed in 53us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448487.208652:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789448487.208680:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448487.208704:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876372317378944:0@lo:400:kworker.0 00000100:00100000:1.0:1789448487.215053:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448487.215695:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317378816 00000100:00100000:1.0:1789448487.215705:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317378816 00000100:00100000:1.0:1789448487.215752:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789448487.215762:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448487.215843:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317378816:12345-0@lo:400:kworker.0 Request processed in 83us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448487.215850:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789448487.215899:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317378816:0@lo:400:kworker.0 00000001:00080000:1.0:1789448487.324591:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789448487.324652:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4db323be-9e14-4d2f-b81e-5e0bd7b89701 00000001:00100000:1.0:1789448487.324660:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789448488.104481:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448488.266971:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4db323be-9e14-4d2f-b81e-5e0bd7b89701 00000100:00100000:1.0:1789448488.333920:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448488.334447:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362688 00000100:00100000:3.0:1789448488.334458:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362688 00000100:00100000:3.0:1789448488.334541:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1789448488.334551:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:13856:x1876372295362688:12345-192.168.202.54@tcp:41:lfs.0 00000004:00000024:3.0:1789448488.334596:0:14404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789448488.334704:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:13856:x1876372295362688:12345-192.168.202.54@tcp:41:lfs.0 Request processed in 154us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448488.334713:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:2.0:1789448488.334836:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448488.371727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.371854:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362816 00000100:00100000:2.0:1789448488.371864:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362816 00000100:00100000:2.0:1789448488.371983:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448488.371994:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:13856:x1876372295362816:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:2.0:1789448488.372033:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448488.372131:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:13856:x1876372295362816:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 138us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.372139:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00080000:3.0:1789448488.373387:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448488.378323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.378529:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295362944 00000100:00100000:2.0:1789448488.378553:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295362944 00000100:00100000:2.0:1789448488.378628:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448488.378638:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:13856:x1876372295362944:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:2.0:1789448488.378677:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789448488.378767:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:13856:x1876372295362944:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.378775:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00080000:3.0:1789448488.378843:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448488.567886:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.567997:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363072 00000100:00100000:2.0:1789448488.568009:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363072 00000100:00100000:2.0:1789448488.568070:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1789448488.568080:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+10:13887:x1876372295363072:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789448488.568096:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448488.568114:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c130b400/0xe29566c2465fab53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f0b3 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.568143:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c130b400/0xe29566c2465fab53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0b3 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.568155:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c130b400/0xe29566c2465fab53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0b3 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.568165:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130b400, rc 0) 00000100:00100000:2.0:1789448488.568266:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363072:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.568273:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:1.0:1789448488.575335:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.575543:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363200 00000100:00100000:2.0:1789448488.575555:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363200 00000100:00100000:2.0:1789448488.575611:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1789448488.575634:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363200:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448488.576053:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363200:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 419us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.576061:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:3.0:1789448488.580456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.580575:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363328 00000100:00100000:0.0:1789448488.580592:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363328 00000100:00100000:0.0:1789448488.580672:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1789448488.580683:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363328:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789448488.582494:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363328:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 1802us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.582509:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:3.0:1789448488.597835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448488.598189:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363456 00000100:00100000:1.0:1789448488.598200:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363456 00000100:00100000:1.0:1789448488.598295:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:1.0:1789448488.598306:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13895:x1876372295363456:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789448488.598703:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13895:x1876372295363456:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 398us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.598712:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:1.0:1789448488.621464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.621604:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363584 00000100:00100000:0.0:1789448488.621616:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363584 00000100:00100000:0.0:1789448488.621673:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:0.0:1789448488.621683:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13895:x1876372295363584:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448488.621978:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13895:x1876372295363584:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 296us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.621988:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1789448488.634323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.634630:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363712 00000100:00100000:2.0:1789448488.634640:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363712 00000100:00100000:2.0:1789448488.634701:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:2.0:1789448488.634711:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13887:x1876372295363712:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789448488.634728:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448488.634747:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d8c130aa00/0xe29566c2465fab5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f0dd expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.634775:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d8c130aa00/0xe29566c2465fab5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0dd expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.634786:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d8c130aa00/0xe29566c2465fab5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0dd expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448488.634794:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130aa00, rc 0) 00000100:00100000:2.0:1789448488.634866:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13887:x1876372295363712:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 155us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.634873:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:3.0:1789448488.645210:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448488.645344:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363840 00000100:00100000:1.0:1789448488.645355:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363840 00000100:00100000:1.0:1789448488.645415:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:1.0:1789448488.645432:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13887:x1876372295363840:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789448488.645473:0:14397:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789448488.645489:0:14397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789448488.645493:0:14397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789448488.645497:0:14397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789448488.645499:0:14397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789448488.649883:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13887:x1876372295363840:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 4448us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.649898:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:3.0:1789448488.658445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.658750:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295363968 00000100:00100000:0.0:1789448488.658760:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295363968 00000100:00100000:0.0:1789448488.658817:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1789448488.658827:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13887:x1876372295363968:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448488.658845:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448488.658866:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f0e4 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.658895:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.658922:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.658932:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32200, rc 0) 00000100:00100000:0.0:1789448488.658988:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13887:x1876372295363968:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 163us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.658995:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:3.0:1789448488.663564:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.663825:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364096 00000100:00100000:2.0:1789448488.663837:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364096 00000100:00100000:2.0:1789448488.663922:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:2.0:1789448488.663932:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c3d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13887:x1876372295364096:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448488.664260:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c3d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13887:x1876372295364096:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 328us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.664268:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789448488.673158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.673260:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364224 00000100:00100000:2.0:1789448488.673270:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364224 00000100:00100000:2.0:1789448488.673324:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1789448488.673334:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13887:x1876372295364224:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789448488.674039:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13887:x1876372295364224:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 704us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.674049:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1789448488.685763:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.685885:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364352 00000100:00100000:0.0:1789448488.685895:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364352 00000100:00100000:0.0:1789448488.685957:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:0.0:1789448488.685968:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13900:x1876372295364352:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448488.686303:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13900:x1876372295364352:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 336us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.686313:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:3.0:1789448488.692320:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448488.695595:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364480 00000100:00100000:2.0:1789448488.695614:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364480 00000100:00100000:2.0:1789448488.695679:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:2.0:1789448488.695689:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13900:x1876372295364480:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448488.695976:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13900:x1876372295364480:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 288us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.695985:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789448488.701967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448488.702073:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364608 00000100:00100000:1.0:1789448488.702083:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364608 00000100:00100000:1.0:1789448488.702129:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448488.702137:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1876372295364608:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789448488.702166:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5@192.168.202.54@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1789448488.702206:0:14403:0:(genops.c:1384:class_connect()) connect: client 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5, cookie 0xe29566c2465fab68 00000004:00100000:1.0:1789448488.702276:0:14403:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789448488.702430:0:14403:0:(import.c:65:import_set_state_nolock()) ffff97d9d2df1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448488.702512:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2347:x1876372295364608:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 373us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.702520:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1789448488.704212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448488.704291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448488.704318:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.704432:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365120 00000100:00100000:0.0:1789448488.704441:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365120 00000100:00100000:0.0:1789448488.704489:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365248 00000100:00100000:0.0:1789448488.704492:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365248 00000100:00100000:0.0:1789448488.704509:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789448488.704518:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295365120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448488.704583:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295365120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 65us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.704590:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789448488.704607:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1789448488.704625:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295365248:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448488.704660:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295365248:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.704666:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789448488.705259:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364992 00000100:00100000:1.0:1789448488.705265:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364992 00000100:00100000:1.0:1789448488.705312:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789448488.705320:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2350:x1876372295364992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448488.705366:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2350:x1876372295364992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 48us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.705373:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448488.711066:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448488.711160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448488.711547:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364864 00000100:00100000:1.0:1789448488.711559:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364864 00000100:00100000:1.0:1789448488.711659:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295364736 00000100:00100000:1.0:1789448488.711663:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295364736 00000100:00100000:1.0:1789448488.711693:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448488.711704:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+7:13887:x1876372295364864:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789448488.711736:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789448488.711803:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+7:13887:x1876372295364864:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 101us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.711811:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789448488.711829:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789448488.711836:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:0:x1876372295364736:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789448488.711953:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789448488.711982:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:0:x1876372295364736:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 146us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.711989:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:3.0:1789448488.712116:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448488.721112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448488.721264:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365376 00000100:00100000:1.0:1789448488.721275:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365376 00000100:00100000:1.0:1789448488.721334:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448488.721343:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:13887:x1876372295365376:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789448488.721514:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:13887:x1876372295365376:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 170us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448488.721523:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1789448488.729615:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.729664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.729692:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.729728:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365504 00000100:00100000:0.0:1789448488.729738:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365504 00000100:00100000:0.0:1789448488.729774:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365632 00000100:00100000:0.0:1789448488.729777:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365632 00000100:00100000:0.0:1789448488.729792:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789448488.729800:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295365504:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789448488.729833:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5@192.168.202.54@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1789448488.729866:0:15088:0:(genops.c:1384:class_connect()) connect: client 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5, cookie 0xe29566c2465fab6f 00002000:00100000:0.0:1789448488.729877:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5/ffff97d9fb0ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448488.729888:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789448488.730133:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789448488.730190:0:15088:0:(import.c:65:import_set_state_nolock()) ffff97d9e7291800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448488.730277:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2347:x1876372295365504:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 475us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.730284:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789448488.730303:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789448488.730310:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876372295365632:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789448488.730326:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5@192.168.202.54@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1789448488.730341:0:15088:0:(genops.c:1384:class_connect()) connect: client 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5, cookie 0xe29566c2465fab76 00002000:00100000:0.0:1789448488.730352:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5/ffff97d9e7295000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448488.730358:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789448488.730510:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789448488.730529:0:15088:0:(import.c:65:import_set_state_nolock()) ffff97d9e7292800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448488.730554:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2347:x1876372295365632:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 243us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.730561:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789448488.730750:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365760 00000100:00100000:2.0:1789448488.730756:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365760 00000100:00100000:2.0:1789448488.730794:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1789448488.730801:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:13887:x1876372295365760:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789448488.730864:0:14406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789448488.730921:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:13887:x1876372295365760:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 120us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448488.730928:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789448488.967880:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448488.968803:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295365888 00000100:00100000:0.0:1789448488.968815:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295365888 00000100:00100000:0.0:1789448488.968996:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1789448488.969008:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:13922:x1876372295365888:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:0.0:1789448488.969028:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448488.969054:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465fab7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f10e expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969119:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969132:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969146:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448488.969180:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448488.969184:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448488.969205:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969274:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465fab7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 8 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969293:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448488.969302:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:0.0:1789448488.969304:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448488.969308:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33000, rc 0) 00000100:00100000:0.0:1789448488.969401:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+7:13922:x1876372295365888:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 394us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448488.969409:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00010000:00010000:0.0:1789448489.114966:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448489.241577:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317379200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448489.241650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448489.241803:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379200 00000100:00100000:2.0:1789448489.241812:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379200 00000100:00100000:2.0:1789448489.241896:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448489.241906:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317379200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448489.241928:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789448489.242012:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448489.247522:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317379200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5608us (5862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448489.247536:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448489.256099:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317379200:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789448489.626025:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448490.138173:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448491.161695:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448491.391694:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5 00000001:00100000:1.0:1789448491.391711:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4db323be-9e14-4d2f-b81e-5e0bd7b89701 00000001:02000400:2.0:1789448491.953208:0:16377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789448492.185579:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448492.314508:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317379712:0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.314585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448492.314662:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789448492.314670:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67d9a8de-e7f1-4030-af60-fc835c982539:3304:1876372317379328:0@lo:400:kworker.0 00000100:00100000:1.0:1789448492.314856:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317379456:0@lo:400:kworker.0 00000100:00100000:0.0:1789448492.314952:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379712 00000100:00100000:0.0:1789448492.314961:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379712 00000100:00100000:0.0:1789448492.315008:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448492.315017:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317379712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448492.316485:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317379584:0@lo:400:kworker.0 00000100:00100000:1.0:1789448492.322368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448492.322972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448492.326281:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317379968:0@lo:400:kworker.0 00000100:00100000:1.0:1789448492.326376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448492.327908:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379456 00000100:00100000:1.0:1789448492.327921:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379456 00000100:00100000:1.0:1789448492.327987:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448492.327999:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317379456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448492.328070:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317379456:12345-0@lo:400:kworker.0 Request processed in 75us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448492.328077:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448492.328102:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379328 00000100:00100000:1.0:1789448492.328107:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379328 00000100:00100000:1.0:1789448492.328135:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789448492.328141:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:3304:x1876372317379328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448492.328176:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:3304:x1876372317379328:12345-0@lo:400:kworker.0 Request processed in 35us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448492.328182:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789448492.328210:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789448492.328237:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1789448492.328253:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448492.328391:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317379456:0@lo:400:kworker.0 00000100:00100000:0.0:1789448492.328898:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876372317379712:12345-0@lo:400:kworker.0 Request processed in 13880us (14310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448492.328908:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448492.328927:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379968 00000100:00100000:0.0:1789448492.328932:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379968 00000100:00100000:3.0:1789448492.330952:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67d9a8de-e7f1-4030-af60-fc835c982539:3304:1876372317379328:0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.330969:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317379840:0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.331025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448492.331064:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876372317379712:0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.331096:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379840 00000100:00100000:3.0:1789448492.331102:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379840 00000100:00100000:0.0:1789448492.333539:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448492.333555:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317379968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448492.333859:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317379968:12345-0@lo:400:kworker.0 Request processed in 308us (7499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448492.333874:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448492.333927:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317379968:0@lo:400:kworker.0 00000100:00100000:2.0:1789448492.334595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448492.334649:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317379584 00000100:00100000:2.0:1789448492.334656:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317379584 00000100:00100000:3.0:1789448492.338153:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448492.338169:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.338286:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876372317379840:12345-0@lo:400:kworker.0 Request processed in 121us (7261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448492.338305:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448492.338371:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876372317379840:0@lo:400:kworker.0 00000100:00100000:3.0:1789448492.338414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317380096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448492.339168:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789448492.339905:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448492.339912:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448492.339926:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380096 00000100:00100000:0.0:1789448492.339935:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380096 00000100:00100000:0.0:1789448492.339974:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448492.339982:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317380096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448492.340017:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448492.340068:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317380096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448492.340198:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789448492.340239:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317380096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448492.341157:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448492.341171:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317379584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448492.341265:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876372317379584:12345-0@lo:400:kworker.0 Request processed in 99us (6670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448492.341274:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448492.341340:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f54c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317379584:0@lo:400:kworker.0 00000100:00100000:0.0:1789448492.341436:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00100000:2.0:1789448492.377547:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5 00010000:00010000:0.0:1789448493.211239:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448493.392915:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78fdf7c2-2ec6-4cec-8980-3ae1681f18e5 00000100:00100000:2.0:1789448494.020329:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448494.020464:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366016 00000100:00100000:0.0:1789448494.020480:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366016 00000100:00100000:0.0:1789448494.020546:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:0.0:1789448494.020558:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2349:x1876372295366016:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448494.020656:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2349:x1876372295366016:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 100us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448494.020665:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1789448494.020864:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448494.021151:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366272 00000100:00100000:0.0:1789448494.021157:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366272 00000100:00100000:0.0:1789448494.021246:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789448494.021255:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2349:x1876372295366272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448494.021293:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2349:x1876372295366272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448494.021307:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00080000:1.0:1789448494.021398:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448494.021551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448494.021599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448494.021628:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448494.021651:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448494.021678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448494.021694:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366784 00000100:00100000:2.0:1789448494.021699:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366784 00000100:00100000:2.0:1789448494.021729:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366400 00000100:00100000:2.0:1789448494.021732:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366400 00000100:00100000:2.0:1789448494.021744:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366656 00000100:00100000:2.0:1789448494.021746:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366656 00000100:00100000:2.0:1789448494.021761:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448494.021769:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2349:x1876372295366784:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448494.021864:0:15088:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789448494.021882:0:15088:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789448494.022015:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448494.022024:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2349:x1876372295366400:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448494.022069:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2349:x1876372295366400:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448494.022076:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448494.022093:0:15088:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789448494.022105:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448494.022111:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2349:x1876372295366656:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448494.022137:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2349:x1876372295366656:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448494.022143:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789448494.022386:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366528 00000100:00100000:0.0:1789448494.022392:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366528 00000100:00100000:0.0:1789448494.022432:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366144 00000100:00100000:0.0:1789448494.022436:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366144 00000100:00100000:0.0:1789448494.022467:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789448494.022474:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2349:x1876372295366528:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448494.022508:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2349:x1876372295366528:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 34us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448494.022514:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789448494.022526:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789448494.022532:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2349:x1876372295366144:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448494.022555:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2349:x1876372295366144:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448494.022561:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1789448494.022627:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2349:x1876372295366784:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 859us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448494.022635:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00080000:2.0:1789448494.022811:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448494.022816:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789448494.022818:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789448494.240603:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448494.362632:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317380224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448494.362737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448494.366156:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380224 00000100:00100000:3.0:1789448494.366180:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380224 00000100:00100000:3.0:1789448494.366300:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448494.366313:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317380224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448494.366381:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448494.366492:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317380224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448494.366500:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448494.366564:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317380224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789448494.366962:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789448495.257980:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789448496.175144:0:16528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff30723520 20000000:00000080:1.0:1789448496.175173:0:16528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97d8c3a4fc00 uarg=0000000000000000 20000000:01000000:1.0:1789448496.175875:0:16528:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789448496.175884:0:16528:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789448496.175891:0:16528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789448496.178098:0:16529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789448496.181522:0:16528:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789448496.195414:0:16528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789448496.197553:0:16528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197584:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa87b expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197593:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197600:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197636:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197643:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197650:0:16528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197710:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.197729:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 12 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.197747:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380352:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448496.198024:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.198033:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 12 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.198042:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380480:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448496.198073:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.198083:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.198105:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380608:0@lo:104: 00000100:00100000:0.0:1789448496.198154:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448496.198200:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.198207:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 18 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.198244:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380736:0@lo:104: 00000100:00100000:0.0:1789448496.198266:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448496.198305:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448496.198314:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 18 pid: 14395 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.198331:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380864:0@lo:104: 00000100:00100000:3.0:1789448496.198470:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380608 00000100:00100000:3.0:1789448496.198480:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380608 00000100:00100000:3.0:1789448496.198530:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380736 00000100:00100000:3.0:1789448496.198532:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380736 00000100:00100000:3.0:1789448496.198549:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448496.198558:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+4:16528:x1876372317380608:12345-0@lo:104: 00010000:00010000:3.0:1789448496.198575:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198635:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448496.198649:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+4:16528:x1876372317380608:12345-0@lo:104: Request processed in 92us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448496.198657:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448496.198677:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448496.198683:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:16528:x1876372317380736:12345-0@lo:104: 00010000:00010000:3.0:1789448496.198692:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198726:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789448496.198731:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67d9a8de-e7f1-4030-af60-fc835c982539+3:16528:x1876372317380736:12345-0@lo:104: Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448496.198736:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789448496.198771:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448496.198784:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198793:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448496.198798:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198807:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448496.198815:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448496.198821:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448496.198859:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198876:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448496.198901:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198909:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae33800/0xe29566c2465faa03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465faa0a expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198923:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448496.198927:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198933:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:3.0:1789448496.198936:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198942:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448496.198949:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448496.198954:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448496.198966:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198972:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448496.198987:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.198994:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fae33600/0xe29566c2465fa8c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa8cf expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.199009:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448496.199011:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448496.199012:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448496.199019:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448496.199043:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317380992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448496.199073:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448496.199119:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317381120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448496.199140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448496.199170:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380992 00000100:00100000:3.0:1789448496.199175:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380992 00010000:00010000:3.0:1789448496.199196:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 19 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448496.199249:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381120 00000100:00100000:3.0:1789448496.199252:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381120 00010000:00010000:3.0:1789448496.199264:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 20 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448496.199277:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448496.199283:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+20:3305:x1876372317380992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448496.199294:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448496.199300:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 20 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.199309:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 20 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.199338:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448496.199499:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+20:3305:x1876372317380992:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448496.199506:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448496.199521:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448496.199527:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+19:3306:x1876372317381120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448496.199534:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448496.199538:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 19 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.199547:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 19 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.199557:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448496.199578:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+19:3306:x1876372317381120:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448496.199585:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448496.199623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67d9a8de-e7f1-4030-af60-fc835c982539:3306:1876372317381120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448496.199647:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317380992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448496.200252:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448496.200297:0:16528:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c81a4780 going to sleep for 11 seconds 00010000:00010000:0.0:1789448496.200315:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d8c130b600/0xe29566c2465faa0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465faa03 expref: 18 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.200341:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380608:0@lo:104: 00010000:00010000:0.0:1789448496.201451:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae33e00/0xe29566c2465fa8cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa8c8 expref: 17 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448496.201469:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380736:0@lo:104: 00000100:00100000:1.0:1789448496.201585:0:14386:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789448496.201610:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317380864 00000100:00100000:1.0:1789448496.201618:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317380864 00000100:00100000:1.0:1789448496.201665:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448496.201673:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:16528:x1876372317380864:12345-0@lo:104: 00010000:00010000:1.0:1789448496.201691:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.201826:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789448496.201832:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67d9a8de-e7f1-4030-af60-fc835c982539+3:16528:x1876372317380864:12345-0@lo:104: Request processed in 160us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448496.201841:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448496.202085:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380864:0@lo:104: 00010000:00010000:2.0:1789448496.202161:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448496.202170:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448496.202178:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27400 already unused, calling callback (ffffffffc1d1cc20) 10000000:00010000:2.0:1789448496.202183:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448496.202192:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448496.202206:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448496.202212:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789448496.202287:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448496.202294:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448496.202333:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448496.202340:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff97d9fad27400/0xe29566c2465fa87b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe29566c2465fa882 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448496.202367:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448496.202369:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448496.202371:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448496.202604:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9d138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317381248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448496.202658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448496.205170:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381248 00000100:00100000:3.0:1789448496.205191:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381248 00010000:00010000:3.0:1789448496.205271:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 17 pid: 14395 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448496.205319:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789448496.205340:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c60ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+17:3307:x1876372317381248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448496.205369:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448496.205376:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 17 pid: 14395 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.205407:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 17 pid: 14395 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.205428:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9d2a34800/0xe29566c2465fa882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe29566c2465fa87b expref: 17 pid: 14395 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.205447:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448496.205546:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c60ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67d9a8de-e7f1-4030-af60-fc835c982539+16:3307:x1876372317381248:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448496.205554:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448496.205897:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448496.205927:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448496.206114:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295366912 00000100:00100000:1.0:1789448496.206121:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295366912 00010000:00010000:1.0:1789448496.206148:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 13 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448496.206165:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367040 00000100:00100000:1.0:1789448496.206168:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367040 00010000:00010000:1.0:1789448496.206179:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 14 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448496.206193:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789448496.206200:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+14:2350:x1876372295366912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448496.206210:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448496.206243:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 14 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206255:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 14 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206271:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448496.206334:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+14:2350:x1876372295366912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448496.206342:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789448496.206368:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448496.206387:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2350:x1876372295367040:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448496.206397:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448496.206401:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 13 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206411:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 13 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206427:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206438:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206457:0:14389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206466:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206473:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206482:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206489:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448496.206501:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206511:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206528:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448496.206539:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448496.206560:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2350:x1876372295367040:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 173us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448496.206567:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789448496.206741:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9d138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67d9a8de-e7f1-4030-af60-fc835c982539:3307:1876372317381248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448496.206968:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32200/0xe29566c2465fab61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0e4 expref: 12 pid: 14396 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448496.206982:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380352:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448496.206994:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9d2a35000/0xe29566c2465fab29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f082 expref: 11 pid: 14397 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448496.207003:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876372317380480:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448496.207033:0:16528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.207043:0:16528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.207050:0:16528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.207056:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97d9fae32600/0xe29566c2465fab8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448496.281464:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448497.284165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448497.284482:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367168 00000100:00100000:1.0:1789448497.284495:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367168 00000100:00100000:1.0:1789448497.284573:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:1.0:1789448497.284585:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+11:13775:x1876372295367168:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448497.284606:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448497.284634:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34000/0xe29566c2465fab92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f115 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.284669:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34000/0xe29566c2465fab92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f115 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.284683:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34000/0xe29566c2465fab92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f115 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.284694:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34000, rc 0) 00000100:00100000:1.0:1789448497.284768:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367168:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 185us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448497.284776:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:2.0:1789448497.295011:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448497.295179:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367296 00000100:00100000:1.0:1789448497.295192:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367296 00000100:00100000:1.0:1789448497.295324:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:1.0:1789448497.295337:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367296:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.296929:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367296:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 1582us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448497.296947:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:2.0:1789448497.301866:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448497.303213:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367424 00000100:00100000:3.0:1789448497.303254:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367424 00000100:00100000:3.0:1789448497.303348:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1789448497.303361:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367424:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00010000:00010000:2.0:1789448497.305824:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448497.306034:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367424:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 1162us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.306058:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1789448497.312685:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448497.312831:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367552 00000100:00100000:1.0:1789448497.312846:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367552 00000100:00100000:1.0:1789448497.312916:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:1.0:1789448497.312929:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+12:13775:x1876372295367552:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448497.312952:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448497.312980:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9d2a34200/0xe29566c2465fab99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f11c expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.313018:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9d2a34200/0xe29566c2465fab99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f11c expref: 13 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.313033:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9d2a34200/0xe29566c2465fab99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f11c expref: 13 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.313044:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34200, rc 0) 00000100:00100000:1.0:1789448497.313135:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13775:x1876372295367552:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 208us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448497.313143:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789448497.329619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448497.334248:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367680 00000100:00100000:3.0:1789448497.334282:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367680 00000100:00100000:3.0:1789448497.334389:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:3.0:1789448497.334415:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13775:x1876372295367680:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.336257:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13775:x1876372295367680:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 1835us (6713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.336276:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:3.0:1789448497.354279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448497.354551:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367808 00000100:00100000:0.0:1789448497.354567:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367808 00000100:00100000:0.0:1789448497.354646:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1789448497.354660:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13775:x1876372295367808:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448497.356394:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:13775:x1876372295367808:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 1725us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.356409:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1789448497.433608:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317381632:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.433705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.434183:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317381504:0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.434321:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317382016:0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.434400:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789448497.434407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317381376:0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.434465:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317381888:0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434487:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.434521:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382016 00000100:00100000:2.0:1789448497.434542:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382016 00000100:00100000:2.0:1789448497.434610:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381888 00000100:00100000:2.0:1789448497.434614:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381888 00000100:00100000:2.0:1789448497.434639:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448497.434649:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317382016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434712:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876372317382016:12345-0@lo:400:kworker.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448497.434720:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448497.434742:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448497.434748:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317381888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434775:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317381888:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448497.434781:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448497.434822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317381888:0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.434833:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876372317382016:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.434856:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448497.434864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317381760:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.434899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448497.434932:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381632 00000100:00100000:0.0:1789448497.434937:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381632 00000100:00100000:0.0:1789448497.434984:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381504 00000100:00100000:0.0:1789448497.434995:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381504 00000100:00100000:0.0:1789448497.435025:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448497.435032:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317381632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.435125:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448497.435134:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317381504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448497.435177:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9d138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317381504:12345-0@lo:400:kworker.0 Request processed in 45us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448497.435192:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448497.435240:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317381504:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.435411:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317381632:12345-0@lo:400:kworker.0 Request processed in 379us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.435419:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448497.435439:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381760 00000100:00100000:0.0:1789448497.435443:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381760 00000100:00100000:0.0:1789448497.435472:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789448497.435477:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317381760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.435508:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876372317381760:12345-0@lo:400:kworker.0 Request processed in 31us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.435513:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789448497.435529:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448497.435534:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448497.435537:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448497.435562:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876372317381760:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.435573:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317381632:0@lo:400:kworker.0 00000100:00100000:0.0:1789448497.439541:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317382144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448497.439639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448497.439823:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317381376 00000100:00100000:3.0:1789448497.439844:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317381376 00000100:00100000:3.0:1789448497.440711:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789448497.440730:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3305:x1876372317381376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448497.441642:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+16:3305:x1876372317381376:12345-0@lo:400:kworker.0 Request processed in 914us (7196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.441657:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 10000000:01000000:3.0:1789448497.441713:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448497.441718:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97da01b5c000 from 10 10000000:01000000:3.0:1789448497.441741:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448497.441788:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.441802:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.441817:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448497.441845:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.441894:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448497.442269:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382272 00000100:00100000:3.0:1789448497.442287:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448497.442871:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382272 00000100:00100000:0.0:1789448497.442946:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789448497.442967:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e6894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+16:14399:x1876372317382272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448497.442987:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448497.443011:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae33c00/0xe29566c2465faba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465faba0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.443469:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae33c00/0xe29566c2465faba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465faba0 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.443487:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae33c00/0xe29566c2465faba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465faba0 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.443499:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33c00, rc 0) 00000100:00100000:0.0:1789448497.443602:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e6894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 646us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.443610:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789448497.443640:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448497.443663:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faba7 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.443673:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465faba7 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448497.443758:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.443795:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448497.443827:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448497.443857:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382400 00000100:00100000:3.0:1789448497.443862:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382400 00000100:00100000:3.0:1789448497.443892:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789448497.443900:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.444346:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.444360:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789448497.444402:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.444434:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.444477:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448497.444498:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d10846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448497.444539:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382528 00000100:00100000:0.0:1789448497.444545:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382528 00000100:00100000:0.0:1789448497.444575:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789448497.444582:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.445135:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317381376:0@lo:400:kworker.0 00000100:00100000:3.0:1789448497.445669:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9eaf15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448497.447823:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3226us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.447842:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789448497.449574:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382144 00000100:00100000:1.0:1789448497.449594:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382144 00000100:00100000:0.0:1789448497.449891:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448497.449903:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317382144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448497.449954:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448497.450333:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317382144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 432us (10694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.450342:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448497.450477:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317382144:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789448497.460422:0:16566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789448497.460832:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789448497.460862:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448497.460877:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faba7 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.460892:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9fad26200/0xe29566c2465faba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465faba7 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448497.460915:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789448497.460918:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9fb0c9000 from 10 10000000:01000000:1.0:1789448497.460922:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789448497.461157:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.461166:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.461180:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448497.461213:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.461347:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448497.461397:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448497.465854:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382656 00000100:00100000:3.0:1789448497.465875:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382656 00000100:00100000:3.0:1789448497.465956:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789448497.465969:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+17:14399:x1876372317382656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448497.466006:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448497.466036:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fad27200/0xe29566c2465fabb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fabae expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.466079:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fad27200/0xe29566c2465fabb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fabae expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.466093:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fad27200/0xe29566c2465fabb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fabae expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448497.466105:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27200, rc 0) 00000100:00100000:3.0:1789448497.466240:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317382656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (4894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.466248:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789448497.466492:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448497.466517:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabb5 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448497.466528:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fabb5 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448497.466843:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.466887:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.466933:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c6b44cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448497.467084:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382784 00000100:00100000:3.0:1789448497.467091:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382784 00000100:00100000:3.0:1789448497.467147:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789448497.467156:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317382784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.467502:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317382784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.467510:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789448497.467672:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.467708:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.467751:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.467768:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9c6b44cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448497.467782:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317382912 00000100:00100000:2.0:1789448497.467786:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317382912 00000100:00100000:2.0:1789448497.467809:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789448497.467816:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317382912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.468134:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317382912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448497.468152:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789448497.468192:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317382912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789448497.473399:0:16569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789448497.473669:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789448497.473693:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448497.473705:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabb5 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448497.473717:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d9d2a35a00/0xe29566c2465fabae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabb5 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448497.473726:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789448497.473728:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97d9d0ac8800 from 10 10000000:01000000:2.0:1789448497.473730:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448497.473781:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448497.473790:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448497.473804:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448497.473832:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448497.473907:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448497.473960:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9eafd5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448497.474297:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317383040 00000100:00100000:0.0:1789448497.474307:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317383040 00000100:00100000:0.0:1789448497.474373:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789448497.474384:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+18:14399:x1876372317383040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448497.474402:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448497.474421:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97d9fae32a00/0xe29566c2465fabc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe29566c2465fabbc expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.474450:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97d9fae32a00/0xe29566c2465fabc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe29566c2465fabbc expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.474478:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97d9fae32a00/0xe29566c2465fabc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe29566c2465fabbc expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448497.474488:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32a00, rc 0) 00000100:00100000:0.0:1789448497.474721:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317383040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448497.474729:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789448497.475249:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448497.475321:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabc3 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.475333:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe29566c2465fabc3 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448497.475417:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.475463:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448497.475498:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789448497.475656:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317383168 00000100:00100000:3.0:1789448497.475663:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317383168 00000100:00100000:3.0:1789448497.475703:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789448497.475711:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9e7aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317383168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448497.476819:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9e7aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317383168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1102us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448497.476842:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789448497.477039:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.477095:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.477147:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448497.477245:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d13a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789448497.483848:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317383296 00000100:00100000:0.0:1789448497.483871:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317383296 00000100:00100000:1.0:1789448497.484731:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789448497.484747:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317383296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448497.485111:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67d9a8de-e7f1-4030-af60-fc835c982539+19:14399:x1876372317383296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (7962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448497.485120:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789448497.485513:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67d9a8de-e7f1-4030-af60-fc835c982539:14399:1876372317383296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789448497.488049:0:16571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789448497.490441:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789448497.490493:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448497.490511:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabc3 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448497.490534:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff97d8c130bc00/0xe29566c2465fabbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe29566c2465fabc3 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448498.330634:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448499.136849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.136971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448499.137109:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368192 00000100:00100000:3.0:1789448499.137120:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368192 00000100:00100000:3.0:1789448499.137173:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368704 00000100:00100000:3.0:1789448499.137175:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368704 00000100:00100000:3.0:1789448499.137184:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368320 00000100:00100000:3.0:1789448499.137186:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368320 00000100:00100000:3.0:1789448499.137194:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368576 00000100:00100000:3.0:1789448499.137196:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368576 00000100:00100000:3.0:1789448499.137259:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789448499.137266:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295368192:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.137515:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295368192:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 248us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.137524:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789448499.137545:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789448499.137552:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2350:x1876372295368704:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.137578:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2350:x1876372295368704:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.137584:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789448499.137593:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789448499.137599:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295368320:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.137624:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295368320:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.137629:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789448499.137641:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448499.137647:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2350:x1876372295368576:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.137670:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2350:x1876372295368576:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.137676:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448499.138073:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368448 00000100:00100000:3.0:1789448499.138082:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368448 00000100:00100000:3.0:1789448499.138130:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368064 00000100:00100000:3.0:1789448499.138134:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368064 00000100:00100000:3.0:1789448499.138171:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1789448499.138178:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2350:x1876372295368448:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.138243:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2350:x1876372295368448:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.138252:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1789448499.138266:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1789448499.138274:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2350:x1876372295368064:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448499.138309:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eaf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2350:x1876372295368064:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.138316:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00080000:1.0:1789448499.138496:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448499.138503:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448499.138507:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448499.139286:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295367936 00000100:00100000:0.0:1789448499.139306:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295367936 00000100:00100000:0.0:1789448499.139361:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1789448499.139369:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2350:x1876372295367936:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789448499.139429:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2350:x1876372295367936:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448499.139436:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00010000:00010000:2.0:1789448499.355074:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448499.483144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317383424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448499.483288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448499.483569:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317383424 00000100:00100000:3.0:1789448499.483582:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317383424 00000100:00100000:3.0:1789448499.483670:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448499.483683:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317383424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448499.483732:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789448499.483794:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317383424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448499.483803:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789448499.484082:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448499.484138:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317383424:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789448499.869157:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789448500.381475:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448500.543549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.543803:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295368832 00000100:00100000:1.0:1789448500.543818:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295368832 00000100:00100000:1.0:1789448500.543902:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1789448500.543915:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f54b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:14433:x1876372295368832:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448500.543944:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.544040:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fabca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f123 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544368:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544387:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544401:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544418:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544425:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.544431:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.545127:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fabdf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.545153:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fabdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.545163:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fabdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448500.545199:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789448500.545204:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448500.545295:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fabdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546485:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546501:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546510:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546517:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.546522:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546531:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546548:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:1.0:1789448500.546551:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.546557:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546594:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546615:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546621:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546627:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546631:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.546634:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546640:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546648:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97d9e0bd6c00) 00010000:00010000:1.0:1789448500.546651:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.546654:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546660:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546722:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fabca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f123 expref: 8 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546752:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34600/0xe29566c2465fabdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f123 expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.546760:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9e0bd6e00) 00010000:00010000:1.0:1789448500.546763:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448500.546765:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34600, rc 0) 00000100:00100000:1.0:1789448500.546879:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f54b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:14433:x1876372295368832:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2966us (3344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448500.546889:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789448500.563753:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.563881:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369088 00000100:00100000:1.0:1789448500.563894:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369088 00000100:00100000:1.0:1789448500.563984:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789448500.563998:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:14433:x1876372295369088:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448500.564027:0:16389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.564055:0:16389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fabe6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f12a expref: -99 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564159:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564178:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564192:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564426:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564468:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.564491:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.565883:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fabfb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.565905:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fabfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.565917:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fabfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448500.565947:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789448500.566358:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566368:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566378:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566385:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.566391:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566401:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566417:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97d9e0bd6e00) 00010000:00010000:0.0:1789448500.566421:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.566426:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566433:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465fabed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566450:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566457:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566476:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566482:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.566485:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566491:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566500:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97d9e0bd6c00) 00010000:00010000:0.0:1789448500.566503:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.566506:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.566512:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fabf4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.571905:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fabe6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f12a expref: 10 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.571954:0:16389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32600/0xe29566c2465fabfb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f12a expref: 9 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.571971:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9cebb6a00) 00010000:00010000:0.0:1789448500.571974:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.571978:0:16389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32600, rc 0) 00000100:00100000:0.0:1789448500.573788:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14433:x1876372295369088:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 9777us (10034us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789448500.573829:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789448500.583728:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.583918:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369216 00000100:00100000:0.0:1789448500.583986:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369216 00000100:00100000:0.0:1789448500.584070:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1789448500.584082:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14433:x1876372295369216:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789448500.584269:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14433:x1876372295369216:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 188us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448500.584277:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1789448500.668542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.668767:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369344 00000100:00100000:0.0:1789448500.668778:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369344 00000100:00100000:0.0:1789448500.668844:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789448500.668853:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14439:x1876372295369344:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448500.668873:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448500.668894:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f131 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.668961:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.668975:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.668988:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669002:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669027:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669034:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669260:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669268:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669274:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669289:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.669294:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669302:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669323:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:0.0:1789448500.669326:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.669331:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669336:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669348:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669360:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669366:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669370:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.669373:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669379:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669387:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97d9cebb6400) 00010000:00010000:0.0:1789448500.669389:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.669392:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669397:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669427:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f131 expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669437:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:0.0:1789448500.669439:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.669442:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f131 expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.669461:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32200, rc 0) 00000100:00100000:0.0:1789448500.669530:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14439:x1876372295369344:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 678us (996us total) trans 0 rc 301/301 00000100:00100000:0.0:1789448500.669537:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789448500.679807:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.679922:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369472 00000100:00100000:0.0:1789448500.679933:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369472 00000100:00100000:0.0:1789448500.679988:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789448500.679999:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14439:x1876372295369472:12345-192.168.202.54@tcp:700:lfs.0 00000100:00100000:0.0:1789448500.680092:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14439:x1876372295369472:12345-192.168.202.54@tcp:700:lfs.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448500.680099:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1789448500.682871:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.682973:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369728 00000100:00100000:0.0:1789448500.682987:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369728 00000100:00100000:0.0:1789448500.683063:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1789448500.683073:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14439:x1876372295369728:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:0.0:1789448500.683136:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448500.683163:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fab4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f0ac expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.683184:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:0.0:1789448500.683189:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448500.683646:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.683661:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 5 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.683678:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.683716:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 5 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.683731:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 5 pid: 14404 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448500.683758:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14402:1876372317383552:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448500.683861:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448500.687199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.687466:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14402:1876372317383552:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448500.687491:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448500.687597:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369856 00000100:00100000:1.0:1789448500.687605:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369856 00010000:00010000:1.0:1789448500.687655:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 6 pid: 14404 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448500.687695:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789448500.687705:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2350:x1876372295369856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448500.687720:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448500.687728:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 6 pid: 14404 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.687946:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 6 pid: 14404 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.687968:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fab84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f10e expref: 6 pid: 14404 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.687983:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:1.0:1789448500.687988:0:14389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.688014:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.688021:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.688051:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448500.688107:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2350:x1876372295369856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 403us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448500.688114:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00010000:00010000:0.0:1789448500.688558:0:14402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.688566:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.688591:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.688601:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.688608:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448500.689950:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789448500.689965:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.689974:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.689981:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.689987:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.689993:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.689999:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.690012:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9e0bd6300) 00010000:00010000:0.0:1789448500.690015:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448500.690019:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.690024:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789448500.690043:0:14402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001e00eaa reply state 00000000fd1889e3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448500.690051:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448500.690149:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:14439:x1876372295369728:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 7074us (7291us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789448500.690167:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00010000:00010000:1.0:1789448500.696932:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.696951:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.696959:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.696966:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.696971:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.696979:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.696997:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97d9cebb6400) 00010000:00010000:1.0:1789448500.697000:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.697006:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.697031:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fac25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448500.799258:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.799468:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295369984 00000100:00100000:0.0:1789448500.799478:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295369984 00000100:00100000:0.0:1789448500.799568:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789448500.799578:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:14447:x1876372295369984:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:0.0:1789448500.799600:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448500.799630:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f138 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799687:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799700:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799711:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448500.799752:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789448500.799755:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789448500.799790:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799811:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fac2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f138 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799828:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33600/0xe29566c2465fac33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f138 expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.799852:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:0.0:1789448500.799855:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448500.799859:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33600, rc 0) 00000100:00100000:0.0:1789448500.799913:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:14447:x1876372295369984:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 337us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448500.799919:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1789448500.839794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.839967:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295370112 00000100:00100000:1.0:1789448500.839978:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295370112 00000100:00100000:1.0:1789448500.840036:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789448500.840047:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:14448:x1876372295370112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448500.840068:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.840092:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f13f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840156:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fac41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840171:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fac41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840182:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fac41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448500.840245:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789448500.840249:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448500.840272:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fac41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840316:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f13f expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840335:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35800/0xe29566c2465fac41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f13f expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.840366:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:1.0:1789448500.840369:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789448500.840373:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35800, rc 0) 00000100:00100000:1.0:1789448500.840437:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:14448:x1876372295370112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 391us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448500.840444:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1789448500.845734:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448500.845921:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295370240 00000100:00100000:2.0:1789448500.845932:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295370240 00000100:00100000:2.0:1789448500.845994:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789448500.846006:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:14448:x1876372295370240:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448500.846027:0:16389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448500.846052:0:16389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f146 expref: -99 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846118:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846134:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846148:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846162:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846169:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846176:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846843:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846854:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846875:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448500.846908:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789448500.846912:0:16389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448500.846932:0:16389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846944:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846951:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846958:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846963:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448500.846967:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846974:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.846986:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:2.0:1789448500.846989:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448500.846995:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847001:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fac4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847024:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847029:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847035:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847040:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130b600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448500.847044:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847050:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847058:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97d9c7d5b100) 00010000:00010000:2.0:1789448500.847060:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448500.847063:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847069:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847103:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f146 expref: 8 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847117:0:16389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f146 expref: 7 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.847135:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:2.0:1789448500.847138:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448500.847140:0:16389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130ba00, rc 0) 00000100:00100000:2.0:1789448500.847208:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+7:14448:x1876372295370240:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1204us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448500.847247:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1789448500.851486:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.851677:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295370496 00000100:00100000:1.0:1789448500.851688:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295370496 00000100:00100000:1.0:1789448500.851749:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789448500.851759:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+7:14448:x1876372295370496:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448500.851780:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.851801:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f14d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448500.851891:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789448500.852006:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f14d expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.852019:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:1.0:1789448500.852022:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448500.852027:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f14d expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.852041:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448500.852101:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+8:14448:x1876372295370496:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 342us (625us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789448500.852124:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1789448500.855655:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448500.855765:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295370752 00000100:00100000:2.0:1789448500.855774:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295370752 00000100:00100000:2.0:1789448500.855826:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:2.0:1789448500.855835:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+8:14448:x1876372295370752:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:2.0:1789448500.855885:0:16389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448500.855911:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f146 expref: 8 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.855929:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:2.0:1789448500.855941:0:16389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448500.855961:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.855973:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.855982:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448500.856172:0:16389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a46e73ba reply state 00000000c331112b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448500.856192:0:16389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789448500.856199:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789448500.856302:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+9:14448:x1876372295370752:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 467us (654us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789448500.856318:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:0.0:1789448500.859100:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859120:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859128:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859134:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448500.859139:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859148:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859165:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5b100) 00010000:00010000:0.0:1789448500.859169:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789448500.859174:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.859179:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465fac72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448500.861713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.861796:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371008 00000100:00100000:0.0:1789448500.861807:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371008 00000100:00100000:0.0:1789448500.861867:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789448500.861878:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+8:14448:x1876372295371008:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789448500.862114:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+9:14448:x1876372295371008:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 237us (410us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789448500.862122:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789448500.868051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.868155:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371264 00000100:00100000:1.0:1789448500.868166:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371264 00000100:00100000:1.0:1789448500.868256:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789448500.868267:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+9:14448:x1876372295371264:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789448500.868326:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.868348:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f154 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868428:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868442:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868454:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868469:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868477:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868484:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448500.868590:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789448500.868673:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868698:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868704:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868710:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.868714:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868722:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868745:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:1.0:1789448500.868750:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.868755:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868762:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465fac80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868776:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868781:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868787:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868792:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.868801:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868807:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868815:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97d9e0bd6600) 00010000:00010000:1.0:1789448500.868817:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.868820:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868826:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fac87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868864:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f154 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868875:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:1.0:1789448500.868877:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789448500.868881:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fac79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f154 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.868891:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34c00, rc 0) 00000100:00100000:1.0:1789448500.868955:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+10:14448:x1876372295371264:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 689us (913us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789448500.868963:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1789448500.874206:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448500.874571:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371392 00000100:00100000:2.0:1789448500.874582:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371392 00000100:00100000:2.0:1789448500.874631:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:2.0:1789448500.874641:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+10:14448:x1876372295371392:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448500.874665:0:16389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448500.874688:0:16389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f15b expref: -99 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874786:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874802:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874813:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448500.874838:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789448500.874842:0:16389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448500.874857:0:16389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874885:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465fac95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 12 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874921:0:16389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 11 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.874930:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:2.0:1789448500.874933:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448500.874937:0:16389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130b600, rc 0) 00000100:00100000:2.0:1789448500.875000:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+11:14448:x1876372295371392:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 361us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448500.875007:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1789448500.881047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.881158:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371520 00000100:00100000:0.0:1789448500.881167:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371520 00000100:00100000:0.0:1789448500.881257:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789448500.881269:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+11:14448:x1876372295371520:12345-192.168.202.54@tcp:37:lfs.0 00000100:00100000:0.0:1789448500.887326:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+11:14448:x1876372295371520:12345-192.168.202.54@tcp:37:lfs.0 Request processed in 6042us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448500.887339:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000040:00080000:1.0:1789448500.891526:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789448500.893796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448500.893902:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371776 00000100:00100000:2.0:1789448500.893915:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371776 00000100:00100000:2.0:1789448500.893974:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:2.0:1789448500.893984:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5462850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+11:14448:x1876372295371776:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448500.894256:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5462850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+12:14448:x1876372295371776:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 272us (532us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789448500.894264:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789448500.979244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448500.979454:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295371904 00000100:00100000:1.0:1789448500.979464:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295371904 00000100:00100000:1.0:1789448500.979530:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789448500.979556:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:14454:x1876372295371904:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448500.979576:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448500.979595:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465faca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f162 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979647:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979658:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979666:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979675:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979679:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979683:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979757:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465facb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979764:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465facb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979770:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465facb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448500.979806:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789448500.979809:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448500.979838:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465facb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979847:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979851:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979856:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979859:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a34800 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.979862:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979867:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979875:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:1.0:1789448500.979877:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.979880:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979884:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465facaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979892:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979903:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979907:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979910:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9d2a35400 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448500.979911:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979915:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979919:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97d9e0bd6600) 00010000:00010000:1.0:1789448500.979920:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448500.979922:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979925:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465facb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979948:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465faca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f162 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979956:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35000/0xe29566c2465facb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f162 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448500.979961:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:1.0:1789448500.979962:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789448500.979967:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35000, rc 0) 00000100:00100000:1.0:1789448500.980076:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+11:14454:x1876372295371904:12345-192.168.202.54@tcp:101:bash.0 Request processed in 522us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448500.980081:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:3.0:1789448500.990100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448500.990213:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295372160 00000100:00100000:2.0:1789448500.990341:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295372160 00000100:00100000:2.0:1789448500.990450:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1789448500.990461:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+11:14454:x1876372295372160:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789448500.990482:0:16389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448500.990504:0:16389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465facbf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f169 expref: -99 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.990630:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.990660:0:16389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 11 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.990670:0:16389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.990707:0:16389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 11 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.990721:0:16389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 11 pid: 16389 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448500.990736:0:16389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16389:1876372317383680:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448500.990823:0:16389:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448500.993861:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448500.993948:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295372288 00000100:00100000:0.0:1789448500.993957:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295372288 00010000:00010000:0.0:1789448500.994251:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 12 pid: 16389 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448500.994350:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789448500.994362:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+12:2350:x1876372295372288:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448500.994378:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448500.994386:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 12 pid: 16389 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.994411:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 12 pid: 16389 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.994433:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:0.0:1789448500.994439:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.994449:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.994457:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448500.994477:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448500.994545:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+12:2350:x1876372295372288:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 186us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448500.994553:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00010000:00010000:2.0:1789448500.995198:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fac9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f15b expref: 11 pid: 16389 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448500.995239:0:16389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16389:1876372317383680:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448500.995259:0:16389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.995267:0:16389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.995272:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.995342:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.995645:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.995654:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996832:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996842:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996849:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448500.996856:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789448500.996876:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996880:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996885:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996888:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448500.996891:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996895:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996913:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:2.0:1789448500.996915:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448500.996918:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996923:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465facc6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448500.996931:0:16389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052884120 reply state 000000001b9ed212 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448500.996937:0:16389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789448500.996966:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465facbf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 14 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996976:0:16389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 13 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448500.996981:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448500.996982:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789448500.996984:0:16389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130b800, rc 0) 00000100:00100000:2.0:1789448500.997056:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14454:x1876372295372160:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6595us (6965us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789448500.997063:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00010000:00010000:1.0:1789448501.001286:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001305:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001315:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001322:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448501.001328:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001337:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001354:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97d9c7d5b700) 00010000:00010000:1.0:1789448501.001358:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448501.001363:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.001370:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a200/0xe29566c2465faccd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448501.013802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.014059:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295372416 00000100:00100000:1.0:1789448501.014071:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295372416 00000100:00100000:1.0:1789448501.014168:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789448501.014179:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:14454:x1876372295372416:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789448501.014246:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448501.014269:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465face2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f170 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.014343:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.014358:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.014371:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448501.014414:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789448501.014419:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789448501.014438:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.014451:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.014483:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465face2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 15 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789448501.014594:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448501.015138:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.015149:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:1.0:1789448501.015152:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448501.015155:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a35400, rc 0) 00000100:00100000:1.0:1789448501.015675:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14454:x1876372295372416:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1496us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448501.015684:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:3.0:1789448501.020399:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448501.020623:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295372672 00000100:00100000:2.0:1789448501.020634:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295372672 00000100:00100000:2.0:1789448501.020687:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448501.020697:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14454:x1876372295372672:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789448501.021066:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14454:x1876372295372672:12345-192.168.202.54@tcp:35:bash.0 Request processed in 369us (677us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789448501.021074:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789448501.173659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.173851:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295372928 00000100:00100000:0.0:1789448501.173862:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295372928 00000100:00100000:0.0:1789448501.173927:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1789448501.173937:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14464:x1876372295372928:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789448501.173963:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448501.173984:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465facf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f177 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448501.174091:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789448501.174211:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465facf0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f177 expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.174266:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97d9cebb6c00) 00010000:00010000:0.0:1789448501.174270:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448501.174288:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465facf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f177 expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.174303:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32200, rc 0) 00000100:00100000:0.0:1789448501.174369:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14464:x1876372295372928:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 433us (719us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789448501.174376:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1789448501.177263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448501.177358:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295373184 00000100:00100000:2.0:1789448501.177368:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295373184 00000100:00100000:2.0:1789448501.177420:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789448501.177429:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14464:x1876372295373184:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448501.177653:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14464:x1876372295373184:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 224us (440us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789448501.177660:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789448501.221980:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448501.222267:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295373440 00000100:00100000:2.0:1789448501.222289:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295373440 00000100:00100000:2.0:1789448501.222375:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789448501.222387:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14467:x1876372295373440:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789448501.222420:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448501.222452:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465facfe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f17e expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.222558:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fad05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.222571:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fad05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.222584:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fad05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448501.222595:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789448501.222759:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ba00/0xe29566c2465facfe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f17e expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.222780:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fad05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f17e expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.222790:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448501.222793:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448501.222797:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130a600, rc 0) 00000100:00100000:2.0:1789448501.222869:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14467:x1876372295373440:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 484us (900us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789448501.222876:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1789448501.226903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.229482:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295373568 00000100:00100000:0.0:1789448501.229496:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295373568 00000100:00100000:0.0:1789448501.229559:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789448501.229568:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14467:x1876372295373568:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789448501.229635:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229653:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229667:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229694:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229701:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229726:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229732:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448501.229736:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229745:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229757:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:0.0:1789448501.229759:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448501.229764:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.229770:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.229859:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14467:x1876372295373568:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 291us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448501.229866:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:3.0:1789448501.232002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.232091:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295373696 00000100:00100000:0.0:1789448501.232102:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295373696 00000100:00100000:0.0:1789448501.232169:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789448501.232179:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:2350:x1876372295373696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448501.232194:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448501.232240:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a600/0xe29566c2465fad05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f17e expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.232288:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:0.0:1789448501.232293:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448501.232344:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9eacc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:2350:x1876372295373696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 167us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448501.232362:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789448501.234293:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448501.234380:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295373952 00000100:00100000:2.0:1789448501.234389:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295373952 00000100:00100000:2.0:1789448501.234434:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789448501.234443:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14467:x1876372295373952:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789448501.234686:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14467:x1876372295373952:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 243us (408us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789448501.234693:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00010000:00010000:2.0:1789448501.401606:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448501.574767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.574923:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295374208 00000100:00100000:1.0:1789448501.574933:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295374208 00000100:00100000:1.0:1789448501.574993:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789448501.575004:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14498:x1876372295374208:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789448501.575028:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448501.575051:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fad1a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f185 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.575151:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fad21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.575166:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fad21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.575178:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fad21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448501.575189:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789448501.575423:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34c00/0xe29566c2465fad1a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f185 expref: 22 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.575443:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fad21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f185 expref: 21 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.575451:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:1.0:1789448501.575454:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448501.575467:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9d2a34800, rc 0) 00000100:00100000:1.0:1789448501.575527:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+21:14498:x1876372295374208:12345-192.168.202.54@tcp:101:cat.0 Request processed in 525us (769us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789448501.575535:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789448501.585842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448501.585931:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448501.585960:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295374592 00000100:00100000:3.0:1789448501.585969:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295374592 00000100:00100000:3.0:1789448501.586026:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789448501.586036:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+21:2350:x1876372295374592:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448501.586052:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448501.586086:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a34800/0xe29566c2465fad21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f185 expref: 21 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.586105:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:3.0:1789448501.586124:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448501.586175:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+20:2350:x1876372295374592:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 140us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448501.586183:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000001:00080000:0.0:1789448501.586908:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:0.0:1789448501.586919:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1789448501.586937:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789448501.586944:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1789448501.586955:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789448501.588032:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295374464 00000100:00100000:2.0:1789448501.588043:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295374464 00000100:00100000:2.0:1789448501.588130:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789448501.588141:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+12:14498:x1876372295374464:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:2.0:1789448501.588516:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:14498:x1876372295374464:12345-192.168.202.54@tcp:35:cat.0 Request processed in 376us (2679us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789448501.588539:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1789448501.664608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.664903:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295374848 00000100:00100000:0.0:1789448501.664914:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295374848 00000100:00100000:0.0:1789448501.664976:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1789448501.664987:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:14504:x1876372295374848:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:0.0:1789448501.665012:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448501.665034:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f18c expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665156:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665171:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 14 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665178:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665198:0:14403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665281:0:14403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665294:0:14403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 14 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.665429:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14403:1876372317383808:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448501.665525:0:14403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 14 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.665534:0:14403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 14 pid: 16389 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.665543:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14403:1876372317383936:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789448501.665570:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ead31540 going to sleep for 11 seconds 00000100:00100000:1.0:1789448501.674805:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.674855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448501.674930:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295375104 00000100:00100000:3.0:1789448501.674940:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295375104 00010000:00010000:3.0:1789448501.674981:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 15 pid: 16389 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448501.675020:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295374976 00000100:00100000:3.0:1789448501.675023:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295374976 00010000:00010000:3.0:1789448501.675037:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 16 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448501.675053:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1789448501.675062:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c60cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:2350:x1876372295375104:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448501.675077:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448501.675084:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 16 pid: 16389 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675096:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 16 pid: 16389 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675118:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:3.0:1789448501.675124:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675150:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675157:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448501.675207:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c60cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:2350:x1876372295375104:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 145us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448501.675236:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1789448501.675292:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789448501.675309:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:2350:x1876372295374976:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448501.675318:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448501.675323:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 15 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675333:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 15 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675344:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:3.0:1789448501.675357:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675366:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675372:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.675390:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448501.675409:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:2350:x1876372295374976:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 110us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448501.675422:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00010000:00010000:0.0:1789448501.676422:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9d2a35400/0xe29566c2465face9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f170 expref: 14 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.676442:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14403:1876372317383808:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448501.676455:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b800/0xe29566c2465facd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f169 expref: 13 pid: 16389 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.676482:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14403:1876372317383936:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789448501.676507:0:14403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.676516:0:14403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.676521:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448501.676539:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789448501.676711:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f18c expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.676725:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33800/0xe29566c2465fad36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f18c expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.676746:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:0.0:1789448501.676750:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789448501.676753:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33800, rc 0) 00000100:00100000:0.0:1789448501.676811:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:14504:x1876372295374848:12345-192.168.202.54@tcp:101:dd.0 Request processed in 11826us (12212us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789448501.676819:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:1.0:1789448501.681318:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.686332:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295375360 00000100:00100000:0.0:1789448501.686359:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295375360 00000100:00100000:0.0:1789448501.686428:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789448501.686439:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:14504:x1876372295375360:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:0.0:1789448501.687599:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.687640:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.687656:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448501.687721:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789448501.687936:0:14404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b9b3948 reply state 00000000880e7cce transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.687947:0:14404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448501.688056:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14504:x1876372295375360:12345-192.168.202.54@tcp:36:dd.0 Request processed in 1616us (6746us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789448501.688064:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000020:00080000:0.0:1789448501.688069:0:14404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789448501.694643:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.694790:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295375488 00000100:00100000:1.0:1789448501.694800:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295375488 00000100:00100000:1.0:1789448501.694860:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:1.0:1789448501.694870:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14504:x1876372295375488:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:1.0:1789448501.694893:0:16389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448501.694921:0:16389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0600/0xe29566c2465fad4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f193 expref: -99 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.694985:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0600/0xe29566c2465fad4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f193 expref: 17 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.695001:0:16389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0600/0xe29566c2465fad4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f193 expref: 17 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.695021:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:1.0:1789448501.695025:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448501.695030:0:16389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a0600, rc 0) 00000100:00100000:1.0:1789448501.695092:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14504:x1876372295375488:12345-192.168.202.54@tcp:101:dd.0 Request processed in 224us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448501.695099:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00010000:00010000:0.0:1789448501.703257:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703286:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703295:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703301:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448501.703307:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703314:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703359:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:0.0:1789448501.703362:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448501.703368:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.703375:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33000/0xe29566c2465fad44 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448501.724544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448501.724724:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295375744 00000100:00100000:3.0:1789448501.724738:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295375744 00000100:00100000:3.0:1789448501.724812:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789448501.724822:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14504:x1876372295375744:12345-192.168.202.54@tcp:103:dd.0 00010000:00010000:3.0:1789448501.724842:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448501.724872:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0600/0xe29566c2465fad4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f193 expref: 16 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448501.724900:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:3.0:1789448501.724906:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448501.724977:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14504:x1876372295375744:12345-192.168.202.54@tcp:103:dd.0 Request processed in 157us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448501.724985:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789448501.727744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.728525:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295375872 00000100:00100000:0.0:1789448501.728542:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295375872 00000100:00100000:0.0:1789448501.728635:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789448501.728647:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14504:x1876372295375872:12345-192.168.202.54@tcp:58:dd.0 00010000:00010000:0.0:1789448501.728755:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.728772:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.728783:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448501.730173:0:14402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448501.730600:0:14402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789448501.730669:0:14402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789448501.730879:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14504:x1876372295375872:12345-192.168.202.54@tcp:58:dd.0 Request processed in 2229us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448501.730889:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789448501.734072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448501.734910:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376000 00000100:00100000:3.0:1789448501.734922:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376000 00000100:00100000:2.0:1789448501.735181:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1789448501.735195:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14504:x1876372295376000:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:2.0:1789448501.735214:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448501.735257:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f19a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735333:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735345:0:14403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735804:0:14403:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735821:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735835:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448501.735838:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448501.735842:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.735850:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d8c130a400, rc 0) 00000100:00100000:2.0:1789448501.735986:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14504:x1876372295376000:12345-192.168.202.54@tcp:101:dd.0 Request processed in 795us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448501.735994:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000040:00080000:1.0:1789448501.913482:0:14437:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789448501.913505:0:14437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448501.913548:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789448501.913555:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789448501.913687:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14437:1876372317384064:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789448501.913805:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9e0a21780 going to sleep for 11 seconds 00000100:00100000:0.0:1789448501.926164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.926192:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14437:1876372317384064:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789448501.926478:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376128 00000100:00100000:3.0:1789448501.926486:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376128 00000100:00100000:3.0:1789448501.926550:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789448501.926561:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376128:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789448501.926644:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376128:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448501.926652:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789448501.929190:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.930159:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376256 00000100:00100000:1.0:1789448501.930170:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376256 00000100:00100000:1.0:1789448501.930338:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1789448501.930359:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376256:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789448501.930390:0:14404:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789448501.930512:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376256:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 164us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448501.930520:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1789448501.938542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448501.938679:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376384 00000100:00100000:2.0:1789448501.938691:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376384 00000100:00100000:2.0:1789448501.938785:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:2.0:1789448501.938796:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376384:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789448501.938880:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938897:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938909:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938925:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938932:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938938:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938960:0:16389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938968:0:16389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.938993:0:16389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448501.939041:0:16389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789448501.939045:0:16389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789448501.939059:0:16389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939071:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939077:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939084:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939089:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448501.939093:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939100:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939112:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9cebb6a00) 00010000:00010000:2.0:1789448501.939115:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448501.939120:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939126:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fad60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939150:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939155:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939161:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939166:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130ac00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448501.939168:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939174:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939180:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97d9c7d5b200) 00010000:00010000:2.0:1789448501.939184:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448501.939186:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939191:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130ac00/0xe29566c2465fad67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939206:0:16389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939211:0:16389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939449:0:16389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939462:0:16389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130be00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448501.939465:0:16389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939471:0:16389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939479:0:16389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448501.939481:0:16389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448501.939485:0:16389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448501.939490:0:16389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fad6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448501.939558:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376384:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 763us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448501.939566:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:2.0:1789448501.941941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.942029:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376640 00000100:00100000:0.0:1789448501.942039:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376640 00000100:00100000:0.0:1789448501.942131:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1789448501.942143:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:14505:x1876372295376640:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448501.942170:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448501.942197:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1a1 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942531:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942546:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942558:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448501.942570:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789448501.942672:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942681:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942687:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942693:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448501.942698:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942721:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942734:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:0.0:1789448501.942736:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789448501.942742:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942747:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fad7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942786:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad75 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1a1 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942796:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97d9cebb6a00) 00010000:00010000:0.0:1789448501.942798:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789448501.942802:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1a1 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.942810:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae33e00, rc 0) 00000100:00100000:0.0:1789448501.942911:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14505:x1876372295376640:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 770us (977us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789448501.942919:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1789448501.949772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.949882:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295376768 00000100:00100000:0.0:1789448501.949895:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295376768 00000100:00100000:0.0:1789448501.949956:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:0.0:1789448501.949966:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14505:x1876372295376768:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789448501.950023:0:14403:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789448501.950131:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14505:x1876372295376768:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 166us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448501.950139:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789448501.965915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448501.966320:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377024 00000100:00100000:1.0:1789448501.966330:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377024 00000100:00100000:1.0:1789448501.966409:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1789448501.966419:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+17:14505:x1876372295377024:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448501.966442:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448501.966464:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fad8a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1a8 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448501.967452:0:14404:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789448501.967460:0:14404:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789448501.967509:0:14404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789448501.967786:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fad91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.967803:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fad91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.967815:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fad91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.967878:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a0a00/0xe29566c2465fad8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1a8 expref: 20 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.967899:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fad91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1a8 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448501.967907:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9e0bd6600) 00010000:00010000:1.0:1789448501.967910:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448501.967913:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1e00, rc 0) 00000100:00100000:1.0:1789448501.970094:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14505:x1876372295377024:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3665us (4178us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789448501.970107:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1789448501.976916:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.977167:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377280 00000100:00100000:0.0:1789448501.977177:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377280 00000100:00100000:0.0:1789448501.977283:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789448501.977301:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14505:x1876372295377280:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789448501.977369:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448501.977400:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9c13a1e00/0xe29566c2465fad91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1a8 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977420:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9e0bd6600) 00010000:00010000:0.0:1789448501.977433:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448501.977455:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977469:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977479:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977494:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977501:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.977527:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978102:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978111:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978118:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978123:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448501.978127:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978135:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978144:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97d9c7d5be00) 00010000:00010000:0.0:1789448501.978147:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448501.978151:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978157:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fad9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978167:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978172:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978184:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978190:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448501.978192:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978199:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978207:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9ad29de (ffff97d9cebb6f00) 00010000:00010000:0.0:1789448501.978209:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448501.978212:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.978261:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32000/0xe29566c2465fada6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ad29de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.980935:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14505:x1876372295377280:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 3632us (4017us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448501.980949:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1789448501.985783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.986176:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377408 00000100:00100000:0.0:1789448501.986187:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377408 00000100:00100000:0.0:1789448501.986261:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:0.0:1789448501.986283:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14505:x1876372295377408:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448501.986310:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448501.986334:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465fadad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1af expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986502:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32400/0xe29566c2465fadb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986516:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32400/0xe29566c2465fadb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986528:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32400/0xe29566c2465fadb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986704:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33a00/0xe29566c2465fadad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1af expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986721:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32400/0xe29566c2465fadb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1af expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.986853:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:0.0:1789448501.986856:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789448501.986860:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fae32400, rc 0) 00000100:00100000:0.0:1789448501.986918:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14505:x1876372295377408:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 648us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448501.986926:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1789448501.993080:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448501.993260:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377664 00000100:00100000:0.0:1789448501.993281:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377664 00000100:00100000:0.0:1789448501.993357:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1789448501.993368:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+19:14505:x1876372295377664:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789448501.993455:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.993491:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448501.993504:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448501.994205:0:14403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789448501.994250:0:14403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 523697031789ns, next at 524696995893ns, rc = 0 00000004:00010000:0.0:1789448501.995259:0:14403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1f3a8ab reply state 00000000150ea14c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448501.995282:0:14403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448501.996147:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+21:14505:x1876372295377664:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2774us (3071us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789448501.996157:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1789448502.004757:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.005805:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377792 00000100:00100000:3.0:1789448502.005818:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377792 00000100:00100000:3.0:1789448502.005897:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789448502.005909:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+21:14505:x1876372295377792:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448502.005935:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448502.005958:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1b6 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.006027:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 22 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.006041:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 22 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.006060:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:3.0:1789448502.006064:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448502.006068:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad26000, rc 0) 00000100:00100000:3.0:1789448502.006135:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+22:14505:x1876372295377792:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 228us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.006142:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00010000:00010000:0.0:1789448502.006999:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007014:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007021:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007027:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33e00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448502.007032:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007041:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007056:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:0.0:1789448502.007059:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789448502.007083:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.007089:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae33e00/0xe29566c2465fadbb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.013805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.013892:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295377920 00000100:00100000:3.0:1789448502.013903:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295377920 00000100:00100000:3.0:1789448502.013973:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789448502.013984:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2351:x1876372295377920:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789448502.014448:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448502.014507:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2351:x1876372295377920:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 523us (710us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789448502.014718:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789448502.022043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.022173:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295378176 00000100:00100000:3.0:1789448502.022183:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295378176 00000100:00100000:3.0:1789448502.022261:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1789448502.022278:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+21:14505:x1876372295378176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789448502.022818:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+22:14505:x1876372295378176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 548us (781us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789448502.022826:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789448502.030972:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448502.031804:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295378432 00000100:00100000:1.0:1789448502.031816:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295378432 00000100:00100000:1.0:1789448502.031933:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1789448502.031945:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+22:14505:x1876372295378432:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789448502.032078:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+22:14505:x1876372295378432:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 135us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448502.032086:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1789448502.046035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.046834:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295378560 00000100:00100000:3.0:1789448502.046846:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295378560 00000100:00100000:3.0:1789448502.046914:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:3.0:1789448502.046924:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+22:14505:x1876372295378560:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448502.046950:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448502.046977:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fadc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1bd expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047073:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047089:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047100:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448502.047136:0:14404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789448502.047156:0:14404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047199:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27000/0xe29566c2465fadc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1bd expref: 24 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047245:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1bd expref: 23 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.047253:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:3.0:1789448502.047257:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789448502.047261:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9fad27e00, rc 0) 00000100:00100000:3.0:1789448502.049065:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+23:14505:x1876372295378560:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 422us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.049085:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789448502.053875:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448502.059638:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295378688 00000100:00100000:1.0:1789448502.059654:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295378688 00000100:00100000:1.0:1789448502.059718:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448502.059729:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2350:x1876372295378688:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448502.059749:0:15087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448502.059772:0:15087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6e09792ec533f1c4 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448502.059800:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d136, blocks: 0x1 00010000:00010000:1.0:1789448502.059821:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1789448502.059825:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448502.059834:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 7 pid: 15087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.059853:0:15087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 7 pid: 15087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.059867:0:15087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97d9c13a1e00, rc 0) 00000100:00100000:1.0:1789448502.059932:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2350:x1876372295378688:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 205us (6067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448502.059939:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789448502.064658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.064761:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295378944 00000100:00100000:2.0:1789448502.064771:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295378944 00000100:00100000:2.0:1789448502.064833:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1789448502.064843:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+23:14505:x1876372295378944:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789448502.064973:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+23:14505:x1876372295378944:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448502.064982:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1789448502.069520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.069628:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379072 00000100:00100000:2.0:1789448502.069640:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379072 00000100:00100000:2.0:1789448502.069700:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1789448502.069712:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+23:14505:x1876372295379072:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789448502.122928:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1789448502.122943:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789448502.122987:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1789448502.123150:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14505:x1876372295379072:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 53435us (53633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.123161:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789448502.124981:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317384192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789448502.125040:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448502.125237:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317384192 00000100:00100000:3.0:1789448502.125245:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317384192 00000100:00100000:3.0:1789448502.125324:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448502.125334:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876372317384192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789448502.125623:0:16445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789448502.125628:0:16445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789448502.125630:0:16445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789448502.125632:0:16445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789448502 -> 1789448502 00002000:00010000:3.0:1789448502.125634:0:16445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789448502.125678:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876372317384192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 345us (637us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789448502.125685:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789448502.126196:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789448502.126287:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97d9f4df0a80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789448502.126304:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876372317384192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789448502.127543:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448502.127680:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379200 00000100:00100000:0.0:1789448502.127690:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379200 00000100:00100000:0.0:1789448502.127757:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1789448502.127767:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2351:x1876372295379200:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789448502.127870:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2351:x1876372295379200:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.127878:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1789448502.131940:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.132066:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379456 00000100:00100000:2.0:1789448502.132080:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379456 00000100:00100000:2.0:1789448502.132149:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1789448502.132161:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14505:x1876372295379456:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789448502.132265:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448502.132534:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad27e00/0xe29566c2465fadd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1bd expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.132555:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:2.0:1789448502.132560:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448502.132599:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.132612:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.132622:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448502.132831:0:14403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc9a823e reply state 0000000002d24234 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.132856:0:14403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448502.133072:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:14505:x1876372295379456:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 913us (1143us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789448502.133079:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1789448502.141092:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.142006:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379584 00000100:00100000:3.0:1789448502.142031:0:16445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379584 00000100:00100000:3.0:1789448502.142108:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448502.142119:0:16445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+7:2351:x1876372295379584:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789448502.142502:0:16445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789448502.142506:0:16445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789448501 00002000:00010000:3.0:1789448502.142508:0:16445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789448501 00002000:00010000:3.0:1789448502.142510:0:16445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789448502 -> 1789448501 00002000:00010000:3.0:1789448502.142512:0:16445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789448502.142568:0:16445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+8:2351:x1876372295379584:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 451us (1485us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789448502.142577:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789448502.145774:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448502.145840:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379712 00000100:00100000:1.0:1789448502.145850:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379712 00000100:00100000:1.0:1789448502.145899:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1789448502.145907:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+8:2351:x1876372295379712:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789448502.145951:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.145969:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448502.145974:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448502.145979:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.145993:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146040:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146049:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146066:0:15087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146073:0:15087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a0200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448502.146077:0:15087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146085:0:15087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146100:0:15087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.146107:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000970c1797/0xe29566c2465fade5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448502.146396:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+8:2351:x1876372295379712:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 488us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448502.146413:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00010000:00010000:0.0:1789448502.146692:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146701:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146707:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146712:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:0.0:1789448502.146716:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146742:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146754:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:0.0:1789448502.146756:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448502.146761:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.146766:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a000/0xe29566c2465fadde lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448502.150514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.150646:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295379968 00000100:00100000:2.0:1789448502.150657:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295379968 00000100:00100000:2.0:1789448502.150715:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:2.0:1789448502.150832:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+14:14505:x1876372295379968:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789448502.150917:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.150933:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.150944:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.151526:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.151543:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 15 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.151552:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.151589:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 15 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.151619:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 15 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.151635:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14404:1876372317384320:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789448502.151783:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448502.159547:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.160166:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14404:1876372317384320:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789448502.160198:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.160881:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380096 00000100:00100000:3.0:1789448502.160889:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380096 00010000:00010000:3.0:1789448502.160926:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 16 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.161015:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789448502.161025:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+16:2351:x1876372295380096:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448502.161041:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448502.161048:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 16 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161072:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 16 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161094:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fad26000/0xe29566c2465fadc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1b6 expref: 16 pid: 14404 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161123:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:3.0:1789448502.161130:0:14387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161139:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161146:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.161175:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448502.161257:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+15:2351:x1876372295380096:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 233us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.161275:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00010000:00010000:2.0:1789448502.161596:0:14404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.161605:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448502.161803:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789448502.161944:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789448502.161988:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789448502.162081:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9ead4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14404:1876372317384448:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789448502.162178:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448502.162240:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9d0543780 going to sleep for 11 seconds 00000100:00100000:1.0:1789448502.162378:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317384448 00000100:00100000:1.0:1789448502.162384:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317384448 00000100:00100000:1.0:1789448502.162422:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448502.162431:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9ead4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14404:x1876372317384448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448502.162505:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9ead4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14404:x1876372317384448:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448502.162512:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448502.162548:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9ead4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14404:1876372317384448:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789448502.163623:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789448502.163692:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14404:1876372317384576:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448502.163745:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448502.163782:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317384576 00000100:00100000:1.0:1789448502.163788:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317384576 00000100:00100000:1.0:1789448502.163813:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448502.163820:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14404:x1876372317384576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789448502.163958:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14404:x1876372317384576:12345-0@lo:1000:mdt00_002.0 Request processed in 138us (212us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789448502.163966:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448502.163986:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9f5368a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448502.164010:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4fedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14404:1876372317384576:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789448502.164037:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164897:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164909:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164915:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130b000 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448502.164919:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164926:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164941:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:1.0:1789448502.164944:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448502.164949:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164955:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b000/0xe29566c2465fadf3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164991:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.164998:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165003:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165008:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:1.0:1789448502.165019:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165027:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165036:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:1.0:1789448502.165038:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448502.165046:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165207:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165279:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.165428:0:14404:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130a400/0xe29566c2465fad59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f19a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448502.165445:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14404:1876372317384704:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789448502.165565:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ef0ad9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448502.172538:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9c7fd9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14404:1876372317384704:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789448502.172572:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172583:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d9fae32200/0xe29566c2465fad52 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172637:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172652:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172663:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172672:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172678:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172684:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172689:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130b600 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448502.172693:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172699:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172708:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448502.172711:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448502.172715:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172719:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130b600/0xe29566c2465fadfa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172737:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172743:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172749:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172754:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130be00 already unused, calling callback (ffffffffc21434f0) 00010000:00010000:2.0:1789448502.172757:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172762:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172769:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97d9c7d5b400) 00010000:00010000:2.0:1789448502.172771:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789448502.172774:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.172779:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fadec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.173096:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14505:x1876372295379968:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 22369us (22591us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789448502.173106:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000020:00080000:2.0:1789448502.173112:0:14404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789448502.173171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.173382:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380224 00000100:00100000:2.0:1789448502.173391:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380224 00000100:00100000:2.0:1789448502.173435:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789448502.173443:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5460050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14504:x1876372295380224:12345-192.168.202.54@tcp:49:dd.0 00000040:00080000:3.0:1789448502.173687:0:14437:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789448502.173692:0:14437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448502.173719:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789448502.173725:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789448502.174620:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5460050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14504:x1876372295380224:12345-192.168.202.54@tcp:49:dd.0 Request processed in 1172us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448502.174629:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789448502.179864:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789448502.182865:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380480 00000100:00100000:2.0:1789448502.182881:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380480 00000100:00100000:2.0:1789448502.183005:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789448502.183016:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c7fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+18:14505:x1876372295380480:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789448502.184988:0:14405:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789448502.185099:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789448502.185155:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185173:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185184:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185193:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185199:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185204:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.185257:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448502.186480:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448502.186492:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.186501:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130be00 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448502.186506:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.186517:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.186537:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97d9cebb6d00) 00010000:00010000:0.0:1789448502.186540:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789448502.186545:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.186552:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97d8c130be00/0xe29566c2465fae01 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.186569:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448502.186582:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448502.186584:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448502.186758:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c7fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+20:14505:x1876372295380480:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 3737us (6898us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789448502.186769:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000020:00080000:2.0:1789448502.186775:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789448502.382956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448502.383003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448502.383026:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.383283:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380608 00000100:00100000:3.0:1789448502.383302:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380608 00000100:00100000:3.0:1789448502.383361:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380736 00000100:00100000:3.0:1789448502.383364:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380736 00000100:00100000:3.0:1789448502.383377:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380864 00000100:00100000:3.0:1789448502.383380:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380864 00000100:00100000:3.0:1789448502.383396:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789448502.383405:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:2351:x1876372295380608:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:3.0:1789448502.383451:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.383492:0:15095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 10 pid: 15087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.383502:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789448502.383507:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448502.383512:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.383550:0:15095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 10 pid: 15087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.383575:0:15095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 10 pid: 15087 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.383593:0:15095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15095:1876372317384832:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789448502.383698:0:15095:0:(client.c:2716:ptlrpc_set_wait()) set ffff97d9ceba9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789448502.390129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.390335:0:15095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f4df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15095:1876372317384832:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789448502.390365:0:15095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.390541:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295380992 00000100:00100000:2.0:1789448502.390548:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295380992 00010000:00010000:2.0:1789448502.390707:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 11 pid: 15087 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.390860:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789448502.390872:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+11:2351:x1876372295380992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448502.390886:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448502.390909:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 11 pid: 15087 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.390923:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 11 pid: 15087 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.390946:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c04e93fc/0xe29566c2465fadd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x6e09792ec533f1c4 expref: 11 pid: 15087 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.390962:0:14389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448502.390966:0:14389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448502.390971:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.390980:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.391024:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448502.391085:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:2351:x1876372295380992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 215us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448502.391092:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00010000:00010000:3.0:1789448502.391152:0:15095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.391161:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.426779:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448502.508299:0:15095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789448502.508310:0:15095:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789448501 -> 1789448502 00002000:00010000:2.0:1789448502.508314:0:15095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1789448502.508330:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508345:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508355:0:15095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508363:0:15095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad26000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448502.508368:0:15095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508377:0:15095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508397:0:15095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.508436:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080366f21/0xe29566c2465fae08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.508542:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+11:2351:x1876372295380608:12345-192.168.202.54@tcp:4:dd.0 Request processed in 125132us (125590us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789448502.508557:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789448502.508602:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1789448502.509278:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:2348:x1876372295380736:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:2.0:1789448502.509336:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa8d136, atime: 0x6aa8d135, ctime: 0x0, blocks: 0x807 00010000:00010000:2.0:1789448502.509344:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.509358:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:2.0:1789448502.509363:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448502.509370:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.509383:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789448502.510789:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1789448502.510811:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:0.0:1789448502.554380:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317384960:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.554639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.554696:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317385472:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.554807:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.554838:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448502.554844:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317385344:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.554867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.554903:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317385088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.554928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.554944:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317385600:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.554968:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.554986:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448502.554992:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97da01c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317385216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.555012:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.555042:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385472 00000100:00100000:0.0:1789448502.555049:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385472 00000100:00100000:0.0:1789448502.555101:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385344 00000100:00100000:0.0:1789448502.555104:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385344 00000100:00100000:0.0:1789448502.555118:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385600 00000100:00100000:0.0:1789448502.555120:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385600 00000100:00100000:0.0:1789448502.555136:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448502.555145:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317385472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.555211:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876372317385472:12345-0@lo:400:kworker.0 Request processed in 67us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.555241:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448502.555260:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448502.555277:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317385344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.555305:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876372317385344:12345-0@lo:400:kworker.0 Request processed in 40us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.555312:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448502.555323:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789448502.555329:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.555360:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876372317385600:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.555365:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789448502.555385:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385088 00000100:00100000:0.0:1789448502.555389:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385088 00000100:00100000:3.0:1789448502.555583:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317384960 00000100:00100000:3.0:1789448502.555589:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317384960 00000100:00100000:3.0:1789448502.555620:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789448502.555627:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:3305:x1876372317384960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448502.555660:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67d9a8de-e7f1-4030-af60-fc835c982539+19:3305:x1876372317384960:12345-0@lo:400:kworker.0 Request processed in 33us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.555665:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789448502.555697:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385216 00000100:00100000:3.0:1789448502.555700:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385216 00000100:00100000:3.0:1789448502.555854:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448502.555862:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317385088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448502.555894:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317385088:12345-0@lo:400:kworker.0 Request processed in 32us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.555900:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789448502.555912:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448502.555918:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317385216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448502.555944:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876372317385216:12345-0@lo:400:kworker.0 Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448502.555949:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789448502.557689:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448502.557696:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448502.557826:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317385216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.557843:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789448502.557848:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97d9f4df0a80, transno 8589934595 00000004:00080000:0.0:1789448502.558506:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789448502.558533:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876372317385088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.558553:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876372317385600:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.558613:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876372317385344:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.558624:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67d9a8de-e7f1-4030-af60-fc835c982539:3305:1876372317384960:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.558649:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97da01c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876372317385472:0@lo:400:kworker.0 00000100:00100000:0.0:1789448502.560874:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f550aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317385728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448502.560938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448502.560994:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385728 00000100:00100000:0.0:1789448502.561002:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385728 00000100:00100000:0.0:1789448502.561047:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789448502.561056:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317385728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448502.561088:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789448502.561132:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876372317385728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448502.561140:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789448502.561184:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f550aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876372317385728:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789448502.579550:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1789448502.579847:0:15095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1789448502.579865:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579896:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579904:0:15095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579910:0:15095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130b600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448502.579915:0:15095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579923:0:15095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579943:0:15095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.579951:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c14e4bf1/0xe29566c2465fae0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.580056:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2348:x1876372295380736:12345-192.168.202.54@tcp:4:dd.0 Request processed in 71441us (197047us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789448502.580066:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789448502.580098:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789448502.580109:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295380864:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:3.0:1789448502.580145:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa8d136, atime: 0x6aa8d135, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1789448502.580157:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.580168:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1789448502.580173:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448502.580179:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.580192:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448502.635247:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1789448502.635498:0:15095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1789448502.635504:0:15095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1789448502.635523:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.635538:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.635547:0:15095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.635553:0:15095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448502.635557:0:15095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.636141:0:15095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.636183:0:15095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.636191:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.638600:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97da01c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2350:x1876372295380864:12345-192.168.202.54@tcp:4:dd.0 Request processed in 56605us (253684us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789448502.638623:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789448502.645611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448502.645661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789448502.645878:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381120 00000100:00100000:1.0:1789448502.645888:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381120 00000100:00100000:1.0:1789448502.645956:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381248 00000100:00100000:1.0:1789448502.645960:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381248 00000100:00100000:1.0:1789448502.646000:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789448502.646010:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+6:2349:x1876372295381120:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:1.0:1789448502.646070:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa8d136, atime: 0x6aa8d135, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789448502.646079:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.646096:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:1.0:1789448502.646101:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448502.646108:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.646123:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.653862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.653904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448502.653933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789448502.654018:0:15093:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789448502.654029:0:15093:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789448502.654360:0:15095:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789448502.654385:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381376 00000100:00100000:2.0:1789448502.654395:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381376 00000100:00100000:2.0:1789448502.654461:0:15095:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789448502.654466:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381632 00000100:00100000:2.0:1789448502.654469:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381632 00000100:00100000:2.0:1789448502.654481:0:15095:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789448502.654486:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381504 00000100:00100000:2.0:1789448502.654488:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381504 00000100:00100000:0.0:1789448502.655148:0:16646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1789448502.655160:0:16646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f5509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:2349:x1876372295381248:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:0.0:1789448502.655205:0:16646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.655276:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448502.655282:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448502.655297:0:16646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.655322:0:16646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448502.764913:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1789448502.768098:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1789448502.768107:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1789448502.768123:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768137:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768147:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768154:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9c13a1600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:2.0:1789448502.768159:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768168:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768187:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768195:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8840cd8/0xe29566c2465fae1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448502.768343:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+12:2349:x1876372295381120:12345-192.168.202.54@tcp:4:dd.0 Request processed in 122329us (122736us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789448502.768353:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789448502.768384:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789448502.768396:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+11:2349:x1876372295381376:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:2.0:1789448502.768424:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768436:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448502.768440:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448502.768446:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448502.768456:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448502.820185:0:16646:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1789448502.820196:0:16646:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789448502 00010000:00010000:3.0:1789448502.820211:0:16646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820255:0:16646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820273:0:16646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820280:0:16646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae32200 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448502.820285:0:16646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820355:0:16646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820389:0:16646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.820396:0:16646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f26e2c9e/0xe29566c2465fae24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.820482:0:16646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f5509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+13:2349:x1876372295381248:12345-192.168.202.54@tcp:4:dd.0 Request processed in 165320us (174816us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789448502.820492:0:16646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789448502.820530:0:16646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789448502.820542:0:16646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+12:2349:x1876372295381632:12345-192.168.202.54@tcp:4:dd.0 00000001:00080000:0.0:1789448502.823354:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:3.0:1789448502.829607:0:16646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.829635:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448502.829640:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448502.829646:0:16646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.829661:0:16646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789448502.875799:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1789448502.876484:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1789448502.876490:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789448502.876504:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876518:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876528:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876536:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d8c130a600 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:0.0:1789448502.876542:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876551:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876634:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876660:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006917a88e/0xe29566c2465fae2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448502.876820:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+10:2349:x1876372295381376:12345-192.168.202.54@tcp:4:dd.0 Request processed in 108423us (222965us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789448502.876829:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789448502.876863:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789448502.876874:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:2349:x1876372295381504:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:0.0:1789448502.876905:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876917:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448502.876921:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448502.876927:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448502.876938:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448502.928472:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789448502.936200:0:16646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1789448502.936237:0:16646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936277:0:16646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936297:0:16646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936305:0:16646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fad27000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:3.0:1789448502.936310:0:16646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936320:0:16646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936340:0:16646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448502.936348:0:16646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fedb2ea/0xe29566c2465fae32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448502.936454:0:16646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+9:2349:x1876372295381632:12345-192.168.202.54@tcp:4:dd.0 Request processed in 115911us (282543us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789448502.936463:0:16646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000001:00080000:2.0:1789448502.968174:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1789448502.968539:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968556:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968636:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968644:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97d9fae33000 already unused, calling callback (ffffffffc16e68b0) 00010000:00010000:1.0:1789448502.968649:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968681:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968701:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448502.968708:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae6ea4b4/0xe29566c2465fae39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448502.968846:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2349:x1876372295381504:12345-192.168.202.54@tcp:4:dd.0 Request processed in 91969us (314906us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789448502.968856:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00010000:00010000:0.0:1789448503.449592:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448504.260321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260395:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789448504.260544:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295382016 00000100:00100000:3.0:1789448504.260555:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295382016 00000100:00100000:3.0:1789448504.260618:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295382528 00000100:00100000:3.0:1789448504.260622:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295382528 00000100:00100000:3.0:1789448504.260638:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295382144 00000100:00100000:3.0:1789448504.260640:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295382144 00000100:00100000:3.0:1789448504.260651:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295382400 00000100:00100000:3.0:1789448504.260654:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295382400 00000100:00100000:3.0:1789448504.260670:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1789448504.260679:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2348:x1876372295382016:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789448504.260765:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2348:x1876372295382016:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 86us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448504.260772:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1789448504.260788:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1789448504.260795:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2348:x1876372295382528:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448504.260970:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295382272 00000100:00100000:2.0:1789448504.260974:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295382272 00000100:00100000:2.0:1789448504.261006:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381888 00000100:00100000:2.0:1789448504.261009:0:16389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381888 00000100:00100000:2.0:1789448504.261034:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1789448504.261040:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2348:x1876372295382272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448504.261073:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+6:2348:x1876372295382272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448504.261087:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1789448504.261101:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789448504.261107:0:16389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+20:2348:x1876372295381888:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448504.261135:0:16389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4db323be-9e14-4d2f-b81e-5e0bd7b89701+20:2348:x1876372295381888:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448504.261141:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789448504.261188:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1789448504.261195:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2348:x1876372295382144:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448504.261245:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4db323be-9e14-4d2f-b81e-5e0bd7b89701+5:2348:x1876372295382144:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 50us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448504.261262:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1789448504.261285:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789448504.261292:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2348:x1876372295382400:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789448504.261315:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2348:x1876372295382400:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448504.261320:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00080000:2.0:1789448504.261347:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448504.261351:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448504.261353:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448504.261731:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372295381760 00000100:00100000:1.0:1789448504.261737:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372295381760 00000100:00100000:1.0:1789448504.261779:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1789448504.261787:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9c6095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2348:x1876372295381760:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789448504.261837:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9c6095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62408e71-32ad-4b6c-9be5-c8230c7ca7d3+13:2348:x1876372295381760:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448504.261843:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1789448504.262718:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f4df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78fdf7c2-2ec6-4cec-8980-3ae1681f18e5+5:2348:x1876372295382528:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1919us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448504.262727:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:2.0:1789448504.476934:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448504.601978:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448504.602008:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97d9f5509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317385856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448504.602102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448504.602190:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876372317385856 00000100:00100000:0.0:1789448504.602202:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876372317385856 00000100:00100000:0.0:1789448504.602461:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789448504.602472:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97d9f550ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317385856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448504.602522:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789448504.602584:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97d9f550ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876372317385856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448504.602592:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789448504.602622:0:14398:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448504.602670:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97d9f5509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876372317385856:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789448504.970093:0:16683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789448505.499621:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448506.521700:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29604 lines, 29604 kept, 0 dropped, 0 bad.